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BACKGROUND AND PLAN FOR THE INTERMEDIATE ENGLISH EVALUATION PROJECT 



/ * 

' ^ ' Lome Dickie, English Consultant 



* Purpose 

This serie"^ of reports contains this procedures, research data and 
backgrdffid information pertai^ning to the Needs Assessment Phase as con- 
ducted by the English Program Planning. Committee from September, 1972 
to the present. -It presents in detail ^11' aspects of the study which is 
an* overall evaluatiofi of student attitude and skill achievement in many 
areas of English Language Arts. 

These reports contain an enormous amount of data which are not 
ends in themselves but should be Considered as valuable dociaments for 
curriculum decision-ftaking. It is hoped that anyone vitally interested 
in curticulum design -will study these documents as a means to that end. 

The reader is cautioned to bear in mind that each report is but 
one part of an integrated study and any inferences made on the findings 
of one report are subject to modification and qualification by findings 
in another. 



Background * 

The ^oyrce of ' the current study in English can be traced to June, 
1972.' At that time, the Superintendent of Curriculum suggested that the 
emphasis in the CurricTUlum De{)artment might be shifted from some other 
areas to English. The Engli^ Consultant then met with"^&earch and . 
Measurement personnel to consider possible mejfchods of approachisig the 
project, which'^ would involve considerable study. In order to devfeljOp a 
Master Plan, thjs Consultant outline^ the following "Points of Concern" 
in July, 1972 : ^ J 

1. Tljere are divergent philosophie| of English held by teachers, consul- 
tants, principals, superintendents and department heads. These 
different philosoJ)hies are manifested in teaching practices and in 
courses of study. 4. 

2. There is an apparent lack of my concenti^ated Coordination regarding 
thQ teaching of reading (other.than remedial). The teaching of read- 
ing is of^en neglected in grades four to thirteen. '^Most current 
thinking suggests that the teaching of reading should be' integrated 
with the English Language Arts Prograih. ' - • 

3. There is a questionable commitment on the part of some educators to- 
ward English. Many teachers and principals claim that English is' 
the most important subject but often practices seem to indicate that 
this is not thexase. • 
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4. Ther€\ is a possible negative attitud^ on the part of students toward 
English. What do students really feel ^about the subject? What should 
an Enalish course io aritd be? Basical ly 'what are the aims and objec- 
tives iof English? ; . 

.5. The pubuic should participate more \in/^de termini ng an English program. 
'What do^s the community expect from a student's English experiences 
in the school system? >~ \ ' j 

6. There is \a lack of coordination of supervisory English. personnel . At 
present there are an English consultant, junior consultants, primary 
consul tan t^, reading consultants, and a drama consultant all involved 
in the general .field of ^glish Language Arts. - Any coordination, 
however, is\ due priraari ly^^^ the efforts of those individuals in 
meeting witf^ each other^in^ prder to clarify their work and their 
long-term pT^s. ' 

\ . *1 

^7. The level" of general English proficiency is an unknown quantity. Are 
parents, educators, the community, and students pleased with the gen- 
« eral level of achievement and attitude in the areas of reading, Jwriting, 
listening, and ^peaking? ' 

• 8. There is a lack t)f meaningful communication among English teachers at 
all levels of the school system. 

9. Because English is not considered a "speciality subject" in the elemen- 
tary level, it perhaps does not receive th"^ emphasis that it should. 
The validi-ty of the assumption that all teachers arg capable of teach- 
ing and want to teach English is open to question, 

10. There is a" lack of integration of the subject. Language, literature, 
composition, a^id spelling are often' presented as ends in themselves 
bearing nq, relationship to one another and having no- substantial in- 
tegration with other subject areas. 

.Ipf^ptember , 1972, the Educational Resources Allocation System 
Task Force ofjthe ^inistry of Education asked if it might monitor the 
Eiiglish department's efforts, since it was in its initial stages. The 
^English^^ogram Planning 'Committee , often referred to as the E.R.A.S. 
English Committee, was formed at that time. The procedures and guide- ' 
lines which were adopted to govern the operation of the Committee are 
as foJ:lows; * " . , * 

r. Jhe English Program Planning Committee^ shal 1 be a continuing Committee 
which will work under the general direction of the English Consultant. 

2.^ Jhe Central Committee shall be made up of the English Consultant, a 
sjtaff member of the Measurement and Evaluation Department, a superin- ' 
tiendent in the Curriculum Department, a secondary school English 
teacher and an elementary school teacher of English. 
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The Conunittee may add members as it sees fit and may form sub- 
committees from time to time as they are required. ' It is hoped that 
trustees, qualified laymen, administrators, parents and students will 
« be involved in the continuing development and evaluation of the Eng- 
lish Curriculum. 

3, The immediate function of the Committee is to organize for the devel- ► 
opment of a curriculum that is sequential, cumulative. and integrated 
and that makes provision for students with different levels of academic 
ability. This plan will be instituted over a period of time, 

4, Members of the E.R.A.S. Task Force and other interested parties shall 
be free to audit the workings of any or all ' committees , subject only 
to the^ approval of the 'Central Committee, 

5, Other procedures may be artic-ulated from t:^e to time by the Central 
C-ommittee. 

The Committee spent most of the Fall of 1972 studying the E.R.A.S. 
philosophy, guidelines and specifications. Meetings with E.R.A.S. officid^ls 
Teading current materials, and planning for the needs assessment projects- 
occupied a considerable amount of the Committee's tim"fe in the initial ; 
stages. Beginning in early Winter 1972 and through.^Winter 1974 the ^Com- 
mittee conducted a series of activitiers regarding curriculiom needs assess- 
ment of the Intermediate Division, ^ ^ ^ ' 



E.R.A.S. Task Force 

E.R.A,S. is the acronym for Educational Resources Allocation System, 
The Task Force, which can trace its beginnings to November, 1971, has as 
its chief goal 'To assist those involved in operating and administering 
schools to achieve more effective management of resources in light of their ' 
immediate and long-term objectives.'^ The aim of the Task Force is not to 
impose additional cost controls on school boards but rather to assist them 
so that the greatest benefit might be achieved for every dollar spent in 
education. Considerable concern has been voi^ced in some quarters that 
E.R.A.S. would impose a behavioural objectives system, a cost accounting 
system, -or a planned program budgeting system upon board jurisdictions. 
The Central Committee- itself had certain reservations in this area at the 
>outset; however, the s e w e r e overcome as its activities progressed accord- 
ing to, modified E.R.A.S, specifications. The Task Force has divided the 
components of a resource allocation system into tTiree major phases. The 
first phase is the planning phase and consists. of assessing needs and 
establishing goals and objectives. The programming phase assigns itself 
to structuring program and defining alternatives. The third phase is the 
evaluation phase which determines the'^value of all aspects. of the system 
including goal:>, objectives, program anc alternatives. 

s 



7 



The Planning Committee in its activities to date haS been concerned 
with phase one, that is assessing the needs and establishing goals and ob- 
jectives. In this phase the planners rrfust be sensitive to the current needs 
of pupils and to the needs of the time. . In addition, educators require some 
analysis of the projected nature of society and the individual. Public in- 
volvement becomes an integral part of the planning phase. In establishing 
objectives it is assumed that^the s>^stem's goals will provide a general 
direction for all the activities within that system. In order to provide 
a basis for mfaking program decisions, implementing plans, and evaluating 
results, program objectives must be formulated and student performance must 
be evaluated in light of ^he* objectives. 

During the Committee^ s involvement with the Task Force, the Task 
Force has been most helpful in giving* advice and a,t no time has imposed 
its specifications upon the Committee., The Task Force which, at regular 
intervals, publishes newsletters, pamphlets, guidelines, etc, has been 
very willing to accept recommendations from the Committee's work. (Further 
detailed information on the E.fi.A.S. Task Force may be obtained by contact- 
ing the Curriculum Department.) 



Planning the Study , 

A flow chart, indicating the general direction that the Committee 
'determined for itself while conducting the Planning Phase of the* study, 
is presented in Figure 1. , 

Using as a philosophical base Ministry guidelines and the London 
Board's basic philosophy, the Committee Considered current literature and 
other published material from various sources. The topics of behaviourism 
and accountability as they related to program development were the critical 
issues faced by the Committee. 

Eight teachers of English were added to the Central Committee to 
farm the Objectives Writing Committee. This Committee also debated the 
accountability issues^ and agreed, th^t objectives which would apply to the 
whble system rather than grade objectives woul4 be establi$hed. It con- 
ducted a series of meetings in which the objectives were written, revised, 
and edited. In addition to the basic areas of reading, writing, listening, 
and speaking, as established by the National' Council of Teachers of English, 
the areas of general and thinking objectives were added. Within each area 
except '^general" both attitude' objectives and skill objectives were formu- 
lated. A total of fifty-four objectives was prepared for teachers to rate. 
A rating sheet, on which teachers indicated the importance of each objective 
and the extent to which each was being met in their school, was distributed 
to approximately fifteen percent of teachers of English ^in the Intermediate 
Division. It was intended that this would provide « consensus regarding the 
priority of objectives and a rough measure of any discrepancies betwe^ 
desired arid actual performance. The results for this " exercise are reported 
in detail in the paper entitled "Stating* the Objectives". 
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The community survey was conducted to determine concerns about the 
English program and its graduates from citizens, parents, and employers. 
The citizen part of the survey Inquired about respondents' reading atti- 
"tudes and habits, ^letter writing characteristics, and opinion? ^regarding 
the usefulness of tKieir experience in school English courses.' The parent 
survey -sought opinions on the proper focus of an Epglish^program, the 
strengths and weaknesses of the Ei^glish program, and reading Habits of , ^ 
.their children. The employer inquiry centered upon three areas: an ' 
employer's requirements of language proficiency for job applicants (includ-., 
ing the administration of tests), employer's opinions about the impart ance ^ 
of communicatian skills in on-the-job situations, and employer's opinions 
of the general communication capabilities of those secondary students 
applying for jobs. 

Personnel in local business, industry, and institutions partici- 
pated in the project. Their responses were recorded and tabulated and 
presented in the ''Community Survey" paper. The function of this paper 
is not to present hard, factual, irrefutable data but rather to identify 
the concerns and opinions* of three different segments of the Community. 

The "Student Attitude Survey" wa^ designed by the Central Committee' 
and edited and approved by a group of elementary school principals. A ten 
percent sample of the student population was selected at random and asked 
to respond to items regarding the usefulness, relevance, enjoyment, and 
difficulty of many aspects of the English program. Students also had the 
oppprtunity to express their Opinions about time spent on vario-us aspects 
of the English program, the materials used, and to respond to an open-* 
ended question regarding the English' program. Since a guarantee of com- 
plete anonymity was required at this time, students, teachers, classes,, 
and schools w6re not identified and the forty-minute survey was administered 
through the office of the principal at all schools. 

Mr. R. D. Latimer, Program Consultant - English, Ministry of Educa- 
tion, visited four secondary schools and eight elemen^tary schools in January, 
1973. Jlis purpose w^s to evaluate, Nthrough classroom observation and dis- 
cussions with teachers, the extent to which objectives in English were being 
achieved and, at the same time, to assess the general strengths and weak- 
nesses of the totar English program in the Intermediate Di^vision,^ He* 
entitled his report "Overview - Language Arts Program". \ 

fn Woven^er, 1973-, a committee of five teachers, chaired by Mr. 
Norm Waite, designed a teacher questionnaire. In addition to demographic 
information and academic qualifications, the survey invited responses in 
the areas of professional reading and membership in professional organiza- 
tions. The adequacy of different aspects of the English program, confidence 
in ability to teach English, and the imporance and rel^evance of English were 
some of the issues \he survey considered. Teathers, respondifig'to kn open- 
endec} question/ gaVe their opinions of the strengths and weaknesses of the 
English program.. 



The '^Student Achievement Survey*' was the most ^.ambitious undertaking 
of the Planning Phase. Although it ^#ould have been desirable to test all 
the obj,ectives, available resources restricted the Committee tq testing'a 
few- basic objectives in each* of the four major areas. A random sampling of 
classes at each grade level produced approximately six hundred students for 
testing purposes. Each student gave background data, responded to a 'brief 
attitude questionnaire, and completed a vocabulary test - the last test to 
be used as a check on the' snatching of sub-samples. 

Classes from grades 7-10 selected randomly from a system-wide popu- 
lation were assigned, again at random, by grade to five 'subsamples each of 
which received a different battery of t^sts. EsTch battery sub-group con- 
tained approximately 120 students at each grade level. 

The students of battery group one were given the Knowledge and Use 
of Reference Materials subtest of the Canadian Tests of Basic Skills . The 
second battery group completed two sections of the Torrance Test of Crea - 
tive Thinking' - '^Asking'* and ^'Unusual Uses'* - and a S.T.E.P .^ reading test. 

Battery group three completed a S . E . P ■ Listening Test while * 
battery group four completed the Canadian Test* of Ba^ic Skills, Form 2 , 
Language Usage subtest. 

The fifth battery group was involved in four tests: a writing . 
assignment which consist«ed of writing a business letter according to 
instructions given,, completing a liking and difficulty questionnaire, 
responding to the Gilmore Oral Reading Test and. taking part in a 'committee- 
designed oral communications test. 

Six teachers required three full weeks to administer the tests. 
Many of the tests had to be hand scored, some acQording to Committee- 
iiesigned criteria, a task which required two scorers six weeks to complete. 

Tl\e Needs Assessment Committee will have as its main function the 
formulation of recommendations for future curriculum design. It will con- 
sider not only tHe data produclh by the various studies and surveys, but ' 
also reactions of any concerned individuals. The English Project will 
then move into Phase II of the E.R.A.S. design, "Programming." 



.^Sequential Tests of Educational Progress 
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.INTERMEDIATE EmiSH EVALUATION fROJECT: STATING THE OBJECTIVES 
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Board of Education, London, Ontario 



c 



The purpose of this project was to develppAan organized, detailed, 
and explicit statement of the objectives of the Interfiiediat'e English pro- 
gram in' London. ' -The need for such a statement be<^ame apparent when k'ey 
personnel involved in the subject suggested^ 

- / ' 

- ' (a)-^that faculty at different >gpade levels held divergent views ' 
^n both- the appropriate content^ and emphasis in an English 
* ^pirogram; ' - 

*-» • 

^) thcTls^there was concern about student's proficiency in ceftain 
skill areas; 

(c) that, in the absence of local guidelines, different expectations^ 
and goals in English were h^ld; and . 



> 



(d) that there was a need for ^greater integration in all areas of 
' the_^English Language Arts Program. 

The Central Committee composed of the English consultant*, an 
administrative' representative ftom Curriculum and Planning, elementary 
and secondary teacher ^representatives , and a specialist ^rom Measurement* 
and Evaluation and Educational Research Services studied the E.R.A.S.^ . 
Initial^tatement . Mindful of Ministry guidelines and the London Board's ^ ^ 
philosophyT^-tlie Committee determined* to state its objectives at the system i? 
program level, (Fi^re 1). These objectives would provide'a general- direc--^ 
*tion .for all Intermediate Division English activities within the system ^ 
but would allow individual schools and teachers ti/ Establish course 
objectives 'and lesson (^jectives. v 

' ■ METHOD . " 

The basic t^sk of classifying the objectives of the Intermediate 
English program was vested^in all Objectives Writing Committee which _con.- 
sisted-'of the Central Committle, four elementary and four secondary 

.teachers and^a staff member from the English Department 6f Althouse 
College of Education. During th§ initial stag^ the Committee, which 

^met 'for a total of twenty hours during /November and December, 1972, . * » 

discussed and debated the whole issue (Si ob jectives--behavioural and ' - • ^ 
otherwise. ^ 



^E.R.-^C. - Educational Resources Allocjation System. 




Worlcing teams were formed and, using ^J^stin^ materials and/or 
their own expertise and initiative, they produced statements of objec- 
tives in the following areas: reading, writing, listening, sp^saking, 
thinking and general. The Committee prepared general, program- level 
^statements rather tlian detailed- goal statements appropriate for each of 
the four grade levels covered by the program. In addition the Committee 
tried to formulate the objectives in terms ji expected 'learner perfor- 
mances in order to facilitate defining rel^Rnt assessment procedures. 
Within each of the six broad categories except general \ objectives 
were divided into attitudinal and skill types. 

. The completed 3tatefnents of objectives were distributed to diff- 
erent groups fbr editing and revision. The groups wfere then restructured 
and a third editing process .conducted. A final meeting refined the objec 
tives furtljer and prepared them for the rating process. 




\ 

• Sixty-Lwo other teachers were asked rate each of the objectives 
in terms of it?. importance, the extent to which it was being met now and 
the need to determine whether or not it should be met. A specially- 
developed Objective Rating Chart (Appendix A)-, used to assist these, 
teachers in making their ratings, provides a complete list of the 54 
■ objectives developed by the original sub-committee. 'Importance' was 
rated on a 5-point, *very important'-to-'unimportant' scale. Teackers 
indicated thfe' extent to which an objective was curreiHly, or should be, 
met using a simple, 'yes - uncertain - no' scale. 

Thirty-- two elementary and thirty secondary teachers completed the * 
* Rating Charts. > The elementary panel was represented by tw^ teachers from 
four representative schpol^ of each of th§ four sectors. Two Intermediate 
teachers from each secondary school represented the secondary^ panel'. 



Data Analysis 

The mean of the importance ratings given each objective was calcu- 
lated, separately for each grade level, along with the percentage of , 
teachers who indicated each objective was or should be met. To sifnplify 
presentation of the data, mean ratings were rounded to the nearest /5 and 
the objectives were grouped into five categories in terms of these mean 
ratings. Each objective in the first category of objectives, having the 
highest mean importance ratings, was given a rank of 1; each objective in 
th^ second group, wittr the next highest ratings, was given a rank of 2, 
and so on so that' eacfi objective in that one-fifth of the objectives with 
-the lowest mean importance ratings was given a rank of 5.- 

^ For each gibjective a mefisure of 'need' was made -by calculating 
the difference between' the percentage of teachers indicating a goal should 
be met and the percentage who indicated it was being met. 

The mean 'importance^ rating for all objectives within each of the 
six major -area^ of the program was also calculated, separately by grade 
level, and the Vank order of each determined. 



RESULTO ' 

The results of the computations described above are summariz.ed in 
Tables 1 and 2. Table 1 gives, by grade level and for each of the 54 , 
objectives: the mean ''importance' rating;^ the 'rank' or major categei^^ 
into which the ofijective falls, and the estimate of 'need' based on th^ 
descrepancy between the pe'fcentage of . teache:fs who judge an objective 
should he met and the -percentage who indicate it is currently being met, 
{This latter , estimate has been simplified into a simple scale, as indica- 
ted in the footnote to Table 1.) Table^2 gives the mean 'importance' 
ratings and their corresponding rank orders, by grade,, for groups. of 
objectives which represent major areas of the English program. 
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TABLE 1 Mean importance rating,. f4nk and . 'need.', for 54 objectives of the Int^r 
mediate English Program, -separately by.grade. . . \ ' ' 
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TABLE 1 - Continued 
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^KEY: Rating : 



Rank: 



5 = Very important, critical or essential 
4 = Above average importance 
3^ = Average importance 
'i->6elow average 4Bportance 
1 = Unimportant, inappropriate, or^ irrelevant 

1. Highest rank (first 5th of ranked scores) 

2. Higher rank (second 5th of ranked scores) 

3. Middle rank (third 5th of ranked scores) 

4. Lower rank (fourth 5th olfcranked scores) 

5. Lowest rank (fifth 5th of ranked scores) 



N^ed ' 
Factor : 



* Strong need to be taught mor^ thoroughly and effectively 
(20% or more than 20% more of the raters indicated*, the 
objective should be met thaa indicated it was now being 
met). 

+ Some need for the objective to be taught more thoroughly 
and effectively. (1(7-20% more of' the raters indicated 
the objective should be met than indicated it was now 
being met. ) 

'0 Objective probably taught effectively enough now. (Diff- 
erence in percent indicating should and now being met in 
the range of +9% to -9%.) 

« 

- Objective not pertinent enough and should be taught less. 
(Difference in* percent indicating should and "now being' 
met is >^-10%. ) 
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TABLE 2 Mean importance ratings and rank of means for broad categories of 
objectives,, separately by grade 
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^ It is apparent from Table 1 that all of the objectives were con- 
sidered to be of at least 'average importance V at all grade levels... no 
objective had a mean rating of less than 3.0. It is also clear that, 
while the relative importance attached to some objectives varies widely 
across grade level (e.g. objective 2), there is considerable consensus 
across grade levels about the importance of some objectives (e.g. objec- 
tive 1). 

There is apparently a wide variation across grade levels in the 
degree to which the objectives are being met. For example, in grade 7, 
the 'need* ratings reflect satisfaction with current performance in 
respect to 80% of the objectives whereas, in grade 9, only 28% are rated 
as being satisfactorily handled. 

t 

It is evident from the mean ratings given in Table 2 that all 
major areas of the English program aVe considered to be of above average 
importance. There seems to be most consensus across grades with respect 
to the relatively "greater importance of attitudinal objectives in the 
areas of reading and speaking and r^lati^ly lesser importance of attitud- 
inal-writing and speaking-skill objective4[^ There is a slight tendency 
for -thinking skills to be regarded as relatively more important than 
thinking attitudes at the elementary level, with the reverse of- this 
pattern at' the secondary level. 
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SUMMARY 



Different committees and groups of grade 7 to 10 teachers •'defined 
'and rated 54 different Int^tniediate English prograih objectives, giTouped 
into six brpad areas. Although all of the objectives were rated as' impor- 
tant, there was considerable variation across beth grades and areas in 
the relative importance attached to them and the exteijt to which ^they were 
judged to be being met. * - 
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ENGLISH LANGUAGE ARTS - OBJECTIVE RATING CHART INTERMEDIATE DIUI§ION 



School : 



Grade V 



Teacher: 



Date: January 1975 



rat](ng key 

*5 ^ Very important, critical, or essential 
4 = Above 'average importance 
3 = Aver^age importance 
2 = B^ow average importance 
i = Unimportant, 'inappropriate, or irrelevant^ 



NOW: 

Does your school 
^Qxpect this ob- 
jective to be ihet 
by students in 
this grade now? 



GENERAL OBJECTIVES : 

1. To provide language Experiences that 'enable 
and encourage one to know himself and his rela- 
tionship to his environment -that is that^ 
6ach child may become more aware of who, he is, 
what he is, and what he may become - what it 
is, in fact, to be a^full human being. I 




Not 
Certain 



SHOULD: 
the school see 
that this objec- 
tiye is being met? 



Yes 



No 



Not 
Certain 



2. To encourage the student to be a battel* 
working and playing member of society through 
interaction with others in an integrated Eng- 
lish Language Arts program of listening, 
speaking, iwri ting and dramatizing. 



3. To provide an environment that produces in 
the* child a 'happy feeling' for, and an appre- 
ciation of language in all its dimensions in 
both print and nonprint forms. 



4. To provide a richness of language exper- 
iences which have as their base the "old 
verities and truths of the heart" - thus to 
widen the student's view of life in general. 
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ENGLISH LANGUAGE ARTS - OBJECTIVE RATING (THART - INTERMEDIATE DIVISION 
School: , ^ Grade: Teacher: ^ Date: January 1975 



RATING KEY 

**5 = Very impprtant, critical, or essential ^ 
4 = Above average importance \ 
3 = Average importance^ , 
2 = Bel OK average fmportance 
1 =, Unimportant , inappropriate, or irrelevant 


Rating 
1 *l-5 


NOW: 

Does yoyr school 
exp^t this 
j ectivel to be met 
by* students in 
this grade now? 


SHOULD: 
the school see 
that this objec- 
tive is being met? 


Yes 


1 

No 


Not 
Certain 


Yes 


No 


Not 
Certain 


THINKING' OBJECTIVES: ATTITUDES 

5. To come to understand that thinking in all 
its form^- logical, enquiry, critical, and 
creative*- is dependent on language. 

f 
















6. To accept the importance of the reality of 
intuition, the« flash of insight, "the 'willing 
suspension of disbelieTV - that is the will- 
ingness to move int;o the context of the 
author's world. ^ 
















7. To understand that communicating is a^three- 
fold transaction involving sender, message and 
receive^; that the greater care and attention 
one give^ to all three of these, the be^tter 
one*s chances for successful communication. 
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ENGLISH LANGUAGE ARTS - OBJECTIVE RATING CHART - INTERMEDIATE DIVISION ^"^ 



School: Grade: • Teacher-: Date; January 1973 



' , ' RATING KEY 

*5 = Veiy important, critical, or essential 
4 = Above average importance 

3 — AvGTacTP i TTiDn Tt an rp 

2 = Below average importance 

1 = Unimportant, inappropriate, or irrelevant 


• 

Rating 
*l-5 


NOW: 

Does your school 
expect this ob- 
jective to be met 
by students in 
this grade now? 


SHOULD 
the school see 
that this objec- 
tive is being met? 


1 Yes 


No 


Not 
>Certain 


Yes 


No 


Not 
Certain 


THINKING OBJECTIVES: SKILLS 

8. To think imaginatively ;/that is hypotheti- 
cally, creatively and. in jIn open-ended manner. 

' ^ i 














* 


9. To understand the differyce between a 
statement of fact and a statement of opinion 
in all language forms; that is, to distinguish 
between a statement that can be operationally 
validated or invalidated from one that cannot. 
















< 

10. To think logically, avoiding the pitfalls 
of fallacious reasoning. ■> ^ 
















11. To gain competence in recognizing and dis- 
tinguishing the effectiveness of many forms 
of language expression - that is to disting- 
uish the profound from the superficial, the 
excellent from the ii\ediocre, the** authentic 
from the sham, etc. 
















\ 

• 

- 

t 
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> 




• 
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ENGLISH LANGUAGE, ARTS - OBJECTIVE RAtll# CHART - INTERMEDIATE DIVISION 

' Grade: ^ Teacher: Date: January 1973 ' 



1 

RATING KEY . 

*5 = Very' important, critical, or essential X 

4 = Above average importance ^ 
' 3 = Average importance 

2 = Below average importance 

1 = Unimportant, inappropriate, or irrelevani^ 


= Rating 
*l-5 


NOW: 

-Does your school 
expect»> this ob- 
jective to be met 
by students in 
^his grade now? 


) ^ 

SHOULD: 
the school see 
that this objec- 
tive is toeing met? 


Yes 


No 


Not 
Certain 


Yes 


No 


Not 
Certain 


KtAUlNb UdJcLTIVES: attitudes 

12. To develop orientation towards -a wide I 
variety of printed material: ^^newspapers , 
magazines, novelsv^etc. 












« 


13« To develop the motivation to seek know- 
ledge and information from a printed source.^-- 
















14. To desire to read /or enjoyment. 


* 














-j -1 

15. To gain pleasure from a response to the 

many forms of literature. 
J 
















16. To gain understanding about one's self amjft 
others from reading widely, selectively, and^ 
critically. j 
















1 

• 

"""^ 

> 










1 

i 
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ENGLISH. LANGUAGE ARTS-- OBJECTIVE RATING GHART - INTERMEDIATE DIVISION 



School; ; ^ d^acie: Teacher: Date: January 1973 



RATI8IG KEY ^ 

*S = Very important, critical, or ess^tial 
4 = Above average importance " —r;^. 
3 = Average importance * . ^\ 
2 = Below average import-ance ^ ^ » • 
1 = Unimportant, inappropriate^ or irrelevant 


Rating 


. ' \ ,NOW: 

•Does your school 
expect this ob- 
jective to be met 
by students in 
this grade now? 


SHOULD: 
the school see 
that this objec- 
tive is being met? 


Yes 


No 


Not 
' Certain 


Yes 


No 


Not ■ 
Certain 


*^ ^ 

READING OBJECTIVES: SKILLS ^ ' ^ 

1^^ To Ijecome competent in acquiring^ a leve'V 
or vocabulary which fulfills, the needs '^of the 
student. ' ^ 














18. To acquire the ability to understand the 
literaU.meaning to follow the line of reason- 
ing and to make valid inferences. 
















19. To be ^familiar with the various j 
(poetry, rjovel, drsuna, short story, ( 
and modes of discourse (narration, d( 
tion, exposition). 


jehres 
2 /say) 
^fecrip- 
















20. To develop research skills inclu 
reading, uses of tables of contents, 
headings, dictionary and library ski 


ling skim 
indexes , 
Is, etc. 
















21. To increase reading speed and ef^ciency. 
















* \ 

22. To read orally with expression, rhythm, 
clarity ar)d proper intonation. 


• 




- 










23. To recognize and be awar^ of different 
levels of meanings b^ond the literal. 
















24. To be ^le to follow written instructions. 
















V 










/ 


r 

/ 

•? 
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ENGLISH LANGUAGE ARTS - OBJECTIVE RACING CHART - INTERMEDIATE DIVISION 



13- 



School 



Grade: 



Teacher: 



Date : ' January 1975 



RATING KEY 

= Very important, critical, or essential 
4 = Above average importance 
3 = Average importance 
2 = Below average importance 



1 = -Unimportant , inappropriate, or 'irrelevant 



WRITING OBJECTIVES: 'ATTITUDES 

25/ To understand that observation, experience, 
and reading provide suitable subjects for 
writing . 




NOW: 

Does your school 
expect this ob- 
jective to be met 
by students, in 
this grade now? 



Yes 



No 



Not • 
Certain 



SHOULD: 
the school see 
that this objec- 
tive is being met? 



Yes 



No 



Not 
Certain 



2fr. To understand that through reading and 
vi|5wing one can find suitable forms for 
written expression. 



27. To enjoy writing. 



28. To understand that words are not things, 
that words are symbols abstracted from - or 
standing for - things; and they are often not 
shared in common by sender and receiver. 
Therefore a writer cannot afford to take too 
much for granted - he mu^t write not only to 
be understood but also -to avoid being misunder- 
stood. . ' 



29. To constantly work toward the imaginative 
and awaj^ from the hackneyed; toward, the orig- 
inal, -and away from the derivative. 



30. To develop a willingness to share written 
thoughts with others. / 



31. To accept and prefer the conventions of 
US-age, spelling, sentence structure, punctua- 
tion, paragraphing and essay writing but to be 
able to violate these . conventions appropriate- 
ly. 



32. To be willing to try various types of 
imaginative writing: poem, stories, plays 
and personal essays. 
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ENGj-ISH LANGUAGE ARTS - OBJECTIVE RATING CHART - INTERMEDIATE DIVISION 

School: >. Grade: - Teacher: Date: January 1975 



■ '\ I.I - — 

RATIN&^-^EY 

"5 = Very important, critical, or essential 
4 = Above average*" importance * 
3 = Average import arvce 
2 = Below average importance 
1.= Unimportant, inappropriate, or irrelevant 


Rioting 
f 

*i-5 


NOW: 

Does your school 
expect ^ this ob- 
jective to be met 
by students . in 
this grade flow? 


• 

SHOULD: 
the school see- 
that this objec- 
tive is being met? 




No 


Not 
Certain 


Ye's 


No 


Not 
Certain 


' WRITING OBJECTIVES: SKILLS 

33. To infer principles of- writing from read- 
• ing widely. 


• 














34. To know how to use one's own imagination 
and experience as primary resources in one's 
writing but to know also how to stimulate 
these resources with controlled observation - ^ 
i.e,, observation with a purpose. 










1 




- 


35. To develop skill in writing exposition, 
narrative, descriptioti and argument. 
















36. To develop the skill of collecting, organ- 
izing and presenting material in a concise, 
coherent and appropriate manner. 














• 


37. To develop precision in written language.; - 
to make calculated choices among words and 
word groups; to differentiate shades of mean- 
ing among alternative expressions; to be able 
to use standard reference books of English 
usage. « 


0 












I 


38. To be able to use the conventions of usage, 
spelling, sentence structure, punctuation, 
paragraphing and essay writing in an approp- 
riate manner. 




\ 












• 

• 


* 
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ENGLISH LANGUAGE ARTS - OBJEOIVE RATIN&-<^ART - INTERMEDIATE DIVISION 



School: ' 



Grad^ 



Teacher: 



Date: January 1973 



*5 

4 
3 
2 



RATING KEY 

= VUpy important/ critical, ot essential 
= Above ayerage ilnportance ^ 
= Average importance _ • ^ 

= ^Below average importancie 



1 =j.*JTviinportant , inappropriate, ^or irrel'^vant^ ^ 



:J'1 



Rating 



. ilSTENING OBJECTIVES:^ ATTITUDES ^ 

39. To ^njoy listening in various situations 
^uch as conversation, drama, television, 
radio, etc. 



NOW: 

Does your schoql 
xpect this ob- 
jective to be met 
by students, in 
.this grade now? 



Yes 



No 



Not 
Certain 



SHOULD: 
the school see ' 
that this oblec- 
tive IS being met 



Yes 



No 



Not 
Certain 



40. To value listening as a ihethod of learning 
which can* be developed. 



41. To be receptive and open-minded, to res- 
pect vajriations in opinion, pronunciation and 
dialect; to listen courteously. 



42. To be willing 'to use information gained 
through listening 'to modify or reinforce one's 
existing knowledge, attitudes, 'beliefs or p 
behaviour. ' * , 



0 



r 



^ -'16 , . . \ ' ^ 

ENGLISH LANGUAGE ARTS - OBJECTIVE RATING CHART 



INTERMEDIATE DIVISION 



School : 



Grade: 



Teacher: 



Date: January 1973 



*5 
4 
3 
2 
1 



RATIf^G KEY 

= Very important, critical, or essential 

= Above average importance 

= Average importance 

= Below average importance 

= Unimportant, inappropriate, nr Irrelevant 



Rating 
*l-5 



LISTENING OBJECTIVES: SKILLS 
43. To be able to follow spoken instructions, 



NOW: 

Does your school 
expect this ob- 
jective to be met 
by students in 
this grade now? 



Yes 



No 



Not 
Certain 



SHOULD: 
the school see 
that this QbjjBC-lp 
tive is being met? 



Yes 



No 



Not 
Certjiin 



44. To follow a verbal presentation and: 
(a) assess a speaker's information, qualifica- | 
tiujis, intentions, and presentation; (b) de- 
cide whether to accept or reject any part or 
-the whole of a^eech - i.e., to decide 
(1) whether the speaker^ is informed or misin- 
formed, (2) whether the speech is logical or 
illogical, effectively or ineffectively 
presented, and (3) whether the various poiTits 
made by the speaker are relevant or irrelevant, 
complete or incomplete. 



45. To gain experience in listening to rhythm, 
rhyme^^ and other sound values of literary 
materials. 
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INTERMEDIATE ENGLISH EVALUATION PROJECT: 
STUDENT ATTITUDES 



This survey represents one part of an overall evaluation plan 
designed t,o assess the current status of London's Intermediate English 
program and produce" recommendations for future developments in curriculum 
and methods. The project is led by a Central Cuiumitcee composed of the 
consultant in -English, an administrator from Curriculum and Planning, 
elementary and secondary teacher representatives, and mei^bers from measure- 
ment-evaluation and research services. Ad Aioc subcommittees of educators 
^ have contribu|^ various aspects of the^ork. ^ 

^» 

The purpose of this survey was to determine student feelings, 
opinions and attitudes regarding English. It was the feeling ot the 
Committee that any needs assessment must take into account the consumer - 
so that his needs be :>atisfied. Indeed the ERAS Initial Statement *^ 
(Revised) states, "sensitivity to the current needs of pupils. ...is 
important to educators/* * • 



r 



o 

Design of the Survey 



METHOD 



The survey instrument was designed largely by the English consultant 
who created most of the items, except those in Part IT. The Central 
Committee revised and edited the items initially and a committee of four 
elementary school principals did the final review. The items in Part II 
were exerpted from the Report on the fcvaluation Workshop in the Affective 
Dosain, (July, 1970), published by the Institute for Educational Research, 

The items were generally designed'to evoke a subjective' rather 
than an objective response to the subject English. These subjective 
responses, of course, will be considered by the Needs Assessment Conmittee 
in context with, other data such as teacher objectives, results of achieve- 
ment tests, community survey, etc' 

Desoription of the 'Student Attitude Survey: 
Intemediate English' (SAS) 

The SAS questionnaire is composed of 6 parts: 

(1) Part I consists of 42 statements about various facets of the 
English course. The student is asked to rate, on a four-point scale, the 
degree to which he agrees with each statement. 

(2) Part II contains 26 questions that inquire about students' 
free reading. Students respond either yes, uncertain or no. 



ERIC 



30 



7 



- 2 



(3) Part III is made up of three sections. The first two sections 
(A B) are an 11- and 8-item semantic differential in terms of which, 
students are asked to characterize 'English' and 'English textbooks' . 
respectively. . In Section C students rate their liking for 6 different 
facets of the English cpurse on a 5-point like-dislike scale. 

(4) In Part IV students were asked to indicate whether or not the 
amount of class tkje spent on each of the same 6 aspects of th'=* English 
course they had jUst rated in Part III-C was 'not enough', 'about right' 
or ' too much' . • 

(5) In Part V elementary students were asked to indicate how many 
teachers taught them various aspects of the English coyrse. Secondary 
Studwts were asked to indicate in which general area academic, commer- 
tial, technical or other they were concentrating their course work. 

^ (6) Part VI of the survey was an open-ended or free response 
•section in which students were asked: to list the literature books they 
liked or disliked th^t year; to suggest additions to, or deletions from 
the English course, and finally to 'tell us something'* j 



Sampling of Students 

for purposes of this stjudy an' attempt was made to select 10% of 
the students in each of grades 7, 8, 9 and 10 so that they would be 
representative of all students in the London system in those grades. For 
practical reasons the sampling procedure was different at the elementary 
and. secondary levels. In grades 7 and 8, IQ% of the students were selec- 
ted randomly from each regular grade 7 and ^ade 8 class in the :ity. At 
the secondary level, a 10% random sample of grade 9 and 10 home- room 
classes was selected from all secondary schools. 

The numbers of students usee in the study, broken down by grade 
and sex, are shown in Table A. Although about equal numbers of :;tudents 
were tested -at elementary (621) and secondary levels (626), the r.ample 
contained a slightly larger number cf boys (683) than girls (564*. 



Table A Number of students given the "Student 
Attitude Survey: Intermediate 
English' by sex and grade. 







Grade 


<• 




Sex 






9 


10 


Totals 


Male 


165 


154 


237 


127 


683 


Female 


155 


147 


135 


127 


564 


Totals 


320 


301 


372 


' 254 


1247 
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Administration of the Attitude Survey * 

-tuThe attitude survey was adlninistered in May, 1973/ by principals 
or vice-principals at the elementary level and by either a tice-principal 
or home-room teacher at the secondary level. 

Using a booklet containing the attitude items and an NCS answer 
sheet, students took approximately 40 minutes to complete the survey. 
In order to encourage forthright responding,, students were askeia to be 
spontaneous and honest. They, were not required to put th^iXjl^ne on 
their answer sheet, and were assured that their answers would not affect 
thei^ grades. They were informed in a very straight- forward manner that 
the survey represented an attempt to determine their attitudes toward 
various aspects of English. 



Statistical Treatment of the Data 

Various computational, procedures were applied to rhe data. 
Initially, simple counts of, and percentages of students giving each 
possible response to each item were calculated, separately by grade and 
sex. For the 68 items comprising Parts I § II of the survey an intercor- 
relation matrix was calculated, factor analyzed by means ^of the Principal 
Components technique and. the resulting factors rotated using the Yarimax 
method. In addition factor scores were calculated for each student and 
subjected to analysis of variance to test for grade and sex trends. 
Checks for significant differences between pairs of mean factor scores 
were made using the Scheffe test. 

For the free or open response section of the survey, students' 
responses were reviewed, an ad hoc classification scheme devised and each 
student's responses allocated to the appropriate content cate^zories. Fer- 
cejits of students' responses falling within each category were then calcu- 
lated. Finally, the authors read through many of the individual student '^s 
responses in an effort to develop a subjective impression of students' ' 
feelings toward English and the survey itself. 

mSULTS 
Farts I 

SPECIAL ANALYSES -AND FOEMAT OF DATA PRESENTATION 

The 68 items comprising Parts I § 11 of the survey, administered 
to approximately 1,250 gii'ade 7 to 10 students, were concerned with 
attitudes toward "various aspects of the English course and free reading. 
rn*.order to simplify consideration of this mass of data, the 68 items were 
int'ercorrelated and the resulting matrix factor-analyzed and the factors 
r^ated. This procedure reduced the 68 items to 15 dimensions or scales 
containing from 1 to 14 items each. The 15 scales fell into three obvious 
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clusters: 4 scales were clearly related to attitudes toward reading; i:, 
9 scales were related to attitudes toward the English course, and 2 scalibs 
fell into a miscellaneous category. 



In order to depict the findings as economically as possible fox* 
purposes of discussion, a Table was prepared for each of the 15 factors 
or scales listing, in order of importance, the items which composed e,ach. 
Beside each item the percentage of boys and girls who 'agreed' with, or 
said 'yes' to each item was presented, separately by grade, in a sub- 
table. 

For purposes of displaying the overall findings for each scale 
factor graphically, the average ^percent agreement across the items composing 
each scale was calculated, separately by sex and grade. The resulting 
averages were plottted in a series of 15 figures which, in a sense, repre- 
sent a sunmary ^of ..the data contained ia .the 15 tables. 

In order to detciTsine which of the many differences in response 
between boys -and girls and students at various grade levels represented 
meaningful rather than chance fluctuations, an additional series of statis- 
tical tests was conducted. First, using the results of the factor analysis, 
15 scale or factor scores were calculated for each student by sin5)ly adding 
up his scores on those items composing each of the various scales.^ The 
students' data were then sorted into 8 sex-grade groups and a one-way 
analysis of variance conducted, in turn, for each of the 15 scale scores. 
Scheffe tests were then made between each of the possible* 28 pairs of means, 
separately for each of^he^lS sets of S scale-score means. This procedure 
permitted a determination of whether or not for any scale, for example, 
grade 7 boys responded differently from boys in grade 8, 9 or 10 or whether, 
at any 'grade level, boys responded differently from girls. 

The results of parts I 5 II of the survey will be presented in 
three main sections: (1) attitudes toward reading (2) attitudes toward 
the English course and (3) attitudes toward other issues. Within each of 
these three sections the factors or scales which pertain to it will be 
discussed in detail. 



ATTITUDE TOilARD READING \ 

A' • / 

The four scales or factors relating to students' attitudes toward 
reading can be briefly characterized as follows: Factor I is composed of 
14 items which are all clearly related to 'enjoyment of reading' ; Factor 
VIII 's 4 items denote students' 'critical involvement in books'; Factor 
X contains 3 items which refer to students' 'awareness of popular reading'^ 
and Factor XII 's 2 items are related to 'access to literature' . 



^In the case of negatively-worded items, the student's scores were reversed. 
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Table 1 , Items contained in Factor I, Enjoyment, of Reading, in order of their 
fa(5tor loa'dings, and percent of students agreeing with each itera by 
sex an^ grade. 



Lo^ading 


Item 
Niimber 


Item 


^Sex 


Grade 


7 


g 


Q 


in 


. 728 


43 


Do you ever read books apart from 
required reading in class? 


M 

F 


71 ' 
86 


71 
86 


65 
78 


56 
80 


[ .625 


63 


Once you have begun a book do you often 
finish within a few days? 


M 

F 


54 
63 


49 

71 


47 
59 


47 
69 


¥ • ' ■ 

' .581 


55 


nave ^uu cvci AC cuiiUDenueu a L/(juK to a 
friend? 


u 

M 

F 


69 
89 


77 
96 


68 
84 


53 
91 


- 

(..569 


m 


Do you re-read a favourite book? 


u 

M 

F 


55 
77 


56 
71 


48 
59 


44 

52 


.556 


52 


uu yuu enjoy reouing noveis or luovie^ 
you have enjoyed? 


M 

F 


51 
74 


59 
78 


46 
62 


40 
66 


•♦.555 


66 


Do you find reading dull? 


u 
M 

F 


15 
12 


16 
10 


18 
13 


24 
13 


t 

\ .540 


45 


nnen you nave extra time in ciass ^ 
do you often read a library book? 


M 

F 


32 
50 


38 
47 


23 
29 


21 
29 


' .S32 


62 


Would you like to have a library in 

yuur nuujt? r 


M 

c 
r 


60 
66 


52 
63 


40 
41 


37 
44 


j .530 
I 


48 


Do you personally own books? 


M 

c 

r 


90, 
94i 


86 
93 


80 
89 


71 
86 


» .526 


47 


Do you enjoy browsing in book stores? 


M 

F 


52 
61 


65 


47 

53 


43 
58 


1 .506 


60 

* 


Are you ever disappointed when a book 
you have enjoyed reading ends? 


M 

F 


62 
76 


57 
80 


53 
70 


43 

70 


.495 


61 


Do you ever get so involved in a book 
that you are unaware of your ^ 
surroundings? 


M 

F 


54 
58 


53 
76 


49 

63 


41 
63 


.463 


58 


Do you feel yqu "learn something" 
about life from reading? 


M 

F 


62 
70 


63 
73' 


s7 
72 


49 

63 


i .457 


57 


Do you ever emotionally respond to a 
story such as laughing, being scared, 
etc.? 


M 

F 


69 
81 


64 

86 


59 
83 


55 
88 
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rCLOtor I - Enjcyment cf Reading 
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Table 1 (p. 5) gives, in order of importance, the 14 items .making 
up this factor and the percentages of students, by sex and grade, who ^ 
•agree' or said 'yes' to each. Students with high scores on this scale: 
do non-required reading; finish books quickly; recamend books to friends; 
re-read favourite books; enjoy reading novels of movies; are interested 
in reading; use extra oleics time to read; would like a home library^ own 
some books J like to browse in book stores; are disappointed at the end of 
an enjoyable book; get involved when they read; feel they learn something" 
about life by reading, and respond emotionally to stoties they read. 

For all items at all grade levels a significantly larger percent- 
age of gijrls than boys agreed with the items making up this scale. As 
is evident from Figure 1, an average of about 15% more girls than boys 
endorse the.se statements. There is also a significant decrease in 'enjoy- 
ment of reading' when students enter secondary school.. In grades 7 and 
8 the average pexcent endorsement of items is about 75 for girls and 62 
for boys whereas, in grades 9 and 10, the comparable figures have fallen 
to 67 and 52. 



Figure 1 



80 



Average percent of students agreeing with tT\W items making up 
Factor I, Enjoyment of Reading, plotted separately by sex for 
grades 7 to 10. 
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. Although the pattern of response does not give a clear indication 
of why students' enjoyment of reading decreases at high school, it may be 
that more of their reading is of the 'required* type and they have less 
opportunity for 'free' reading during school hours. It is also possible 
tha;t reading, as a pleasurable leisure time pursuit, has to conpete with ^ - 
other attractive social and exti*a-curricular activities. 



Factor VIII - Critical Involvement in Books ' 

Ta^le 2 lists the 4 iteas making up this factor and the percent- 
ages of students, by sex and grade, who 'agree' or said 'yes* to each*. 
Students with high scores on this scale: let a book's length influence 
their decision to read it; are critical of a book's structure; have 
been influenced by books, and have strongly identified with characters 
in the books they have read. This factor a^ears to represent a tendency 
to approacV books in a fairly mature, critical manner and to be influenced 
personally by them. 



Table 2 I^ms contained in Factor 8, Critical Involvement to Books, in order 
of their factor loadings^ and percent of students Agreeing with each 
item by sex anil gra^e. 



Loading 


Item 
Number 


Item 


Sex 


Grade 


7 


8 


9 


10 


.498 


67 


Are you influenced by how many pages a 
book has before you read it? 


M 

F 


48 

27 


38 
29 


42 
38 


43 
32 


.463 


64 


Do you ever express a negative opinion 
of a book from the standpoint of plot,\ 
character development, etc.? 


M 

F 


29 

27 


29 
29 


33 

37 


30 
44 


.457 


65 


Have any of the books you have read 
significantly influenced your life 
in any way? 


M 

F 


34 
36 


32 
43 


26 
40 


26 
25 


.414 


54 


Have you ever strongly identified with 
a character or characters in a book you 
have read? 


M 

F 


35 

37 


33 

48 ' 


30 
43 


34 
44 



'Only aboufSO to 40 percent of boys and girls agreed with the items 
in this scale and there were no major shifts in endorsement of the items 
as a function of grade level (See Figure 2.). Girts agree significantly 
more often wi^h tjiese i.tems than boys, but only at the secondary level. 
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Fi|(gure 2 Average percent of students agreeing with the items making up 
Factor 8, Critical Invoivement in Books, plotted separately 
by sex' for grades 7 to ^0. 
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GRADE 
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Boys show a slight, but statistically significant, decline in their endorse- 
ment of these items from grade 7 to grade 9. In general, the sex and grade 
differences are small and probably not of practical significanc^. 

Factor X - AjjXiremse of Popular Reading 

The 3 items coaqprising tJiis scale are listed in Table 3 and the 
average percentages of endorsemervt of the items are plotted in Figure 3, 
separately by sex and grade. Students scoring high on this scale read 
book reviews, know best selling books and read the newspaper fairly 
regularly. In short, they are avmre of current literature. 

Although about half of the students are fairly regular readers of 
the newspaper, less than, a quarter of them read book reviews and only 
about 15% are aware of 'Best sellers'. 

— J 

Boys generally endorse the items making up this scale more often 

than girls but this difference has disappeared by grade 10. There are no 

statistically^ significant change^in average percent agreement with these 

items as a function of grade level* 
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Tabl« 3 Items contained in Factor 10, Awareness of Popular Reading, in order 
of their factor loadings, and percent of students agreeing with each 
item by sex and grade. 





Item 
NuBber 






Grade 


Loading 


Item 


Sex 


7 


8 


9 


10 


.675 


46 


Do you r^d ihe book review section of 
magazines and newspapers? 


M 

F 


26 
21 


23 
19 


20 
16 


15 
27 


.607 


51 


Do you know what. book is at the top of 
the best seller list? 


M 

F 


H 
9 


12 
9 


18 
10 


A"; 

14 

r 


.531 


49 


Do you read the newspaper fairly 
regularly? 


M 

F 


51 
48 


62 
49 


59 
50 


60. 
56 



Figure 3 Average percent of students agreeing with the itfims- making up 
Factor 10, Awareness of Popular Reading, plotted separately 
by sex. for grades 7 to 10. 
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35 



30 



25 



Male 



Female 
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GRADE 



10 



Factor XII - Access to Literature 

The 2 items making up this scale are listed in Table 4 and the 
average percentage of endorsement of the items is depicted graphically, 
separately by'' sex and grade, in Figure 4. 

Students endorsing tTtese items both own a library card and sub- 
scribe to one or more magazines. Although th^se two items belong on the 
same Scale from a statistical point of view, the pattern of student 
endorsement by sex and grade suggests that they may reflect somewhat 
different underlying interests or attitudes. Whiler about three quarters 
of the girls in all grades own a iTbrary xard, less than two thirds of 
the senior elementary boys do ^nd at the secondary level this has fallen 
to about one half. On the other hand, a slightly larger percentage of 
boys subscribe to magazines than do girls at all grade levels and there 
are no significant changes as a function of grade level. 

SuTTfiary 

In general, it appearssthat girls probably read and enjoy reading 
more than boys at all grade levels. There is also a trend for all students 
tb enjoy reading less as they go from elementary to secondary school and 
this effect appears to be more pronounced in the case of boys. 



Table 4 Items contained in Factor 12, Access to Literature, in order of their 
factor loadings, and percent of students agreeing with each item by 
sex and grade. 



Loading 


Item 
Number 


Item 


Sex 


Grade 


7 


8 


9 


10 


.677 


• 44 


Do you own a library card? 


M 

F 


64 
76 


61 
71 


53 
67 


46 
75 


.366 


50 


Do you subscribe to any magazines? 


M 

F 


35 
50 


38 
32 


41 
50 


38 
35 



59 
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Figure 4 Average percent of students agreeing with the items making up 
Factor 12, Access to Literature, plotted separately by sex 
for grades 7 to 10. 
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ATTITUDE TOWARD ENGLISH CLASSES AND COURSES 



The 9 factors clustering around students' attitudes toward English 
classes and courses can be briefly^ characterized as follows: Factor H 
contains 10 items all related quite directly to 'enjoyment of English 
clasaea'; Factor III consists of 6 items which reflect: students ' views 
on the 'ueefulneaa of grammar^; Factor IV' s 7 items relate to students* - 
perception of the *pepaonal irrelevccnae of Engliah'; Factor V, containing 
4 items, is concerned primarily w^th students' 'enjoyment of writing'; 
Factor VI consists of 4 items which reflect students' assessment of the 
'difficulty of Engliah' as a course; the 4 items comprising 4^ac tor VII 
reflect the 'diatastefulneaa of reading and writing toptoe' as perceived 
by students; Factor IX, with 3 items, relates to students' perceived 
Hnsecurity in maatering Engliah akilla'; the single item which represents 
Factor XIV reflects a student attitude of the 'uaeleaaneaa of correct 
apelling'; Factor XV contains a single item iwhich reflects students' 
assessment' of the 'noiae and activity in Engliah claaaea'. 
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Factor II - Enooyment of English Classes 



* Table 5 gives, in order of'.impbrtance , the 10 items ©aking up this 
factor Ind the percentages of students, by sex and grade, who 'agree' or 
sai4 'yes' to each. The correspohdi'Ae averages of Dercentaj7e endnrc 



- O - 7 w^*- ^A«*x«v., -11^ O^X^^ \Ji, 

The corresponding averages of percentage endorsement 
of the 10 items have been. plotte^n Figure 5, separately by grade and 



'S 
0 

sex. 



T^ble 5 Items contained In -Factor 2, Enjoyment of English Classes, in order of 
' their . factor loadings, and percent of students agreeing with each item 

by sex and grade. ' 



T 



Loading 


Item 
Number 


Item 


Sex 


Grade 


1 


8 


9 


10 


• -.780 


18 


English classes are fun. 

, — '- — ^ '■ 


M 
F 


35 
45 


43 

47 


49 
45 


48 
51 


\ 755 , 


9 


I look forward to going to English 

UlODb caL.ll ^ 'li^jr • ^ 


M 
r 


34 
43 


31 
47 


37 
40 


40 
42 


.740 


2 


I enjoy English classes. ^ 


M 
F 


54 

75 


62 
80 


61 
64 


58 
68 


'.728 


37 


' L find that most of my English classes, 
artf interesting. , . 


M 

F 


43 
62 


44 
62 


47 
47 


49 
50 


.713. 


14 . 

— V- 


H — ^ y — 

I feel that the English classroom is 
a happy place. 


M 
F 


32 
42 


32 
49 


51 
39 


52' 
45 


.689 


10 


I would rather attend , English class ^ 
than most other classes. ^ 


M 
F 


29 

27 


23 
34 


27 
33 


33 
41 


-.552 


12 


I thirik English is dull. 


M 

t 


50 

37 


57 
44 


47 
49 


41 
50 


• - .541 


25 


I never have any f,un in" English class.. 


M . 
F 


-35 
32 


33 
19 


29 
36 


28 
24 


.362 


4 


I^feel that English isthe most * . 
important subject in th^^curriculutn. 


M" 

F 


40 

59 
_ _t, 


42 
61 


34 
39 


40 
44 


.307 i 


23 


When we hav^ class discussion, they 
are worthwhile. 


M 
F 


78 
84 


78 

go 


64 

67 


68 

67 . 
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Figure 5 



Average percent of students agreeing with the items making* up 
Factor 2, Enjoyment of English Classes, plotted separately by 
sex for grades 7 to 10. 
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Students endorsing this set of items: f^d Engl ish classes fun; 
look forward to and enjoy tliem; regard English cl^s^FSs" a happy, inter- 
esting place and woi^ld rather go there than most other classes; feel that 
English is the most important subject *and that the class discussions are 
'"worthwhile. , ^ ^ 

As is apparent' from Figure 5,. about^O% of students at, each grade 
level agree with these statements which refiilct enjoyment of English 
classes. A significantly larger percentage of girls than boys endorse 
the items at grade^ 7 and' 8. However, due to a major negative shift in 
girls'* attitudes at the secondary level, the , sex difference is not j 
apparent in grades 9 and 10, . 



Factor III - Usefulness of Granmar 

The 6 items making up Factor III are listed in Table 6 and the 
corresponding averages of percents of students endorsing the items have 
been plotted in Figure 6, Separately by graded and sex. 
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Table 6 



Items contained in Factor 3, Usefulness of Grammar, in order of their 
factor loadings, and percent of students agreeing with each item by 
sex and grade. 





Item 
Number 






Grade 


Loading 


Item 


Sex 


7 


8 


9 


10 


.655 




The study of grammar helps ray writing 


M 
F 


74 


79 


63 


\J\J 

65 


.623 


19 


I try to apply the grammar rule^ that 
I have learned when I am writing. 


M 
F 


78 
86 


71 
84 


65 
69 


68 
74 


.617 


. 28 


The granmiar I study is necessary. 


M 
F 


77 
83 


68 
83 


57 
59 


63 
61 


.5,19 

/ 


26 


I believe that people who use poor 
grammar are poorly educated. 


M 
F 


46 
47 


44 
44 


37 
40 


44 
32 


/506 


40 


t ^ 

Punctuat,ion rules are good to know. 


M 
F 


84 
92 


81 
91 


74 
83 


82 
84 


' .369 


3 


The material studied in English is 
fcurrent and relevant. 


M 
F 


65 
81 


67 
75 


SO 
46 


55 
60 



er!c\ 



Figure 6 Average percent of students agreeing with the items making up 
Factor 3, Usefulness of Grammar, plotted separately by sex for 
grades 7 to 10. 
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Students who agree with this set of items: feel that grammar 
*itudy helps their writing; believe* that grammar is necessary; apply 
grammar rules when writiag; agree that a well educated person uses good 
grammar; feel that ptmctuation rules are good to know, and that material m' 
studied in English is current and relevant. 

Seconifary level students are significantly less likely to regard 
grammar as useful than elementary level students. The average percenf** 
endorsement of the items on this scale falls from about 72% for grades 7 
and 8 to about 60% for grades 9 and 10. While a significantly, larger 
percentage of girls than boys feel that gramnar is useful,, this difference 
becomes progressively less as grade level increases so that, by grade 10> 
it has disappeared. 

Factor IV - Personal Irrelevance Of English 

The 7 items comprising Factor IV are listed in Table 7 and the 
sex by grade curves for average percent 'endorsement plotted in Figure 7. 

Table 7 * Items contained in Factqr 4, Personal Irrelevance of English, in order 
of their factor loadings, and percent of students agreeing with each 
item by sex and grade. 





Item 
Number 






Grade' 


Loading 


Item 


Sex 


7 


8 


9 


10 


.594 


6 


I feel that the goals of Eng^lish are 
not useful in my daily life. 


M 

F„ 


32 
27 


37 
25 


36 
28 


38 
37 


.561 


8 


I will probably not use anything that 
I have done in English again. 


M 

F 


18 
17 


23 
8 


27 
24 


27 
27 


.527 


32 


I do not feel that English plays an 
important place in my life. 


M ' 

F 


28 

21 


28 
17 


35 
35 


35 
29 


.508 


7 


I am ifiore concerned with the grade in - 
English rather than. what value I get 
from it. 


M 

F 

? 

•i 


45 
36 


47' 
38 


45 
51 


49 
37 


- .455 


1 


I feel /hat what I learn in English 
will . influence my futiire.' 


M 

F 


82 
93 


85 
93 


82 
75 


75 
82 


-.416 , 




1 think that the material studied in 
TSngflish"'helps prepare me for finding 
a job. 

' v' 


M 

F 


76 
81 


66 
78 


54 
52 


44 

52 


.341 • 


15 


I think I would like to ^drop English 
^"next year. 


M 

F 


32 
21 


23 
11 


26 
25 


18 
24 
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Figure 7 Average percent of students agreeing with the items making up 
Factor 4, Personal Irrelevance of English, plotted separately 
by sex for grades 7 to 10. ' 
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Students with high scores on this scale: feel that English goals 
are not useful; doubt that they will use English skills again; rate 
Enfc;lish as unimportant in their lives; are concerned with grades in, 
rather than values of English; don't feel English skills will influence 
their future or prepare them for a jcfc, and would like to djop English 
next year. In simi, students agreeing with these itenis regard English as 
largely irrelevant to their needs. 

The percentage of students with this nci^ative evaluation of 
English increases, in a'statistically significant manner, from about 24 
in grades 7 and 8 to about 34 in grades 9 and 10. At the elementary 'level 
a significantly greater percentage of boys than girls (29 vs 20) express 
these negative feelings. However, a substantial decrease in the percent- 
age of older girls who feel English is personally relevant obliterates 
the sex difference at the high school level. 

Factor V - Enjoyment of Inviting } 

Factor V is composed of the 4 items* listed in Table 8, for which 
summary percentage agreement averages have been plotted in Figure 8. 
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Table 8 Items contained in Factor 5, Enjoyment of Writing, in order of their 
factor loadings, and percent of students agreeing with each item by 
sex and grade. 



Loading 


Item 
Number 


Item 


Sex 


Grade 


' 7 


8 


9 


10 


.643 


29 


I like writing poetry. 


M 
F 


36 

57 


31 
50 


20 
49 


22 
43 


- .522 


38 


I enjoy writing short stories. 


M 

F 


65 
75 


66 
78 


47 
56 


46 
50 


.466 


'30 


Memory work is a worthwhile activity. 


M 

F 


45 
56 


36 
51 


31 
34 


31 
28 


.385 


S3 


Do you enjoy attending plays? 


M 

F 


46 
63 


36 
64 


29 
50 


21 
58 



Figure 8 Average percent of students agreeing with the items making up^ 
Factor 5, Enjoyment of Writing, plotted separately by sex for 
grades 7 to 10. 
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The content of Factor V involves items related to students' enjoy- 
ment of writing poetry and short stories, attending plavs and placing 
value on memorizing verse. 

A significantly^ larger percentage of girls than boys endorse these 
items at all grade levels. However, the average percentages of both boys 
and girls agreeing with the items falls steadily from grade 7 to grade 10. 
For girls*, the average percent endorsement falls from about 63 to 45; for 
boys it falls from 48 to 30. As with several otfier scales, the most marked 
shift occurs between elementary* and secondary school. 

FoQtoT VI - Difficulty of^English 

The 4 items included in Factor VI are listed in Table 9 and the 
summary percentage agreement averages across items are displayed graphically 
in Figure 9. 

Table 9 Items contained in Factor 6, Difficulty of English, in order of their 
factor loadings, and percent of students ag.reeing with each itero^ by 
sex and grade. 





Item 
Number 






Grade 


Loading 


Item 


Sex 


7 


8 


9 


10, 


.643 ' 


11 


English is too difficult. 


M 

F 


26 
30 


27 
22 


25 
31 


20 

-29 


.627 


13 


High marks in English are top hard 
to obtain. 


M 
F 


40 
25 


34 
20 


43 
43 


35 
42 


-.548 


16 


English is too easy. 
• 


M 

F 


13 
19 


17 
20 


16 
18 


18 
13 


-.434 


39. 


I am pleased with my accomplishments 
in English this year. 


M 

F 


52 
68 


65 
74 


49 , 
56 


50 
57 




The/Items contain assertions that; English is too difficult;' high 
marks in^glish are too hard to obtain, and dissatisfaction with accomp- 



in English this year. 



>ince Items with negative loadings correlate negatively with the factor, 
the sense of the item in terms of the pattern of student response requires 
reversing its stated meaning. E.g., compare items 11 § 16. 



ERLC 



ii 



19 



Figure 9 Average percent of Students agreeing with the items making up. 

JT Factor 6, Difficulty^ of. English, plotted separately by sex 
' . " for grades 7 to 10. ) 
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At the elementary 16vel a significantly smaller percentage of ^irls 
than boys find English too difficult. However, at the secondary level 
girl's estimation of the difficulty of English has increased to equal that 
of the boys. This latter shift is the only statistically significant- grade 
trend. About a third to one half of all students agree tnkf" English is 
difficult. 



Factor VII - Distastefyilneaa of Reading and Writing Topics 

Factor VII's 4 items are listed* in Table *tO and^the sex by grade 
percentage agreement averages plotted in Figure 10. • , 

Students endorsing these items regard English class stories as 
boring, and the writing topics phony, artificial and uninteresting. They 
do not feel they have an opportunity to write about topics upon which they 
are knowledgeable. 
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Table 10 Items contained in Factor 7 / Mstastefulness of Reading and Writing 
Topics, in order of their factor loadings, and percent of students 
agreeing with each item by sex and grade. 





Item 
hfeunber 








Grade 




Loading 


Itenr 


Sex 


7 


8 


9 


10 


.615 


21 


The stories I read in English class are 
boring. 


M 

F 


38 
36 


43 

36 


44 

42 


40 
4fi 


.573 


33 


The writing topics that I an assigned 
are phony and artificial. 


M 

F 


30 
29 


44 

25 


34 
30 


42° 
43 


-.411 


22 


I am assigned interesting writing' 
topics. 


M 

F 


46 
60 


44 

58 


54 

37 


39 
37 


-.380 


36 


I get the opportunity to write on 
topics which I know about. 


M 

F 


58 
59 


48 

67 


47 
44 


50 
43 



Figure 10 Average percent of students agreeing with the items making up 
Factor 7, Distastefulness of Reading and Writing Topics, 
plotted separately by sex for grades 7 to 1(^ 
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Students' disenchantment with their assigned reading and writing 
topics increases significantly over the elementary- secondary transition. 
While a- significantly larger percentage of elementary boys than girls 
are negative, the increase in the percentage of girls sharing this, 
attitude obliterates the sex difference at the secondary level. The ' 
approximately 38% of students endorsing these items at grade 7 increases 
to abPut 50% in grade 10. 



' Factor IX - Insecurity in Mastering English Skills 

The -3 items making up Factor IX are listed in Table 11. The 
corresponding average percent of agreement figures are plotted in Figure 
11, separately by sex for grades 7 to 10.. 

Students who agree with these items indicate that they: soon 
forget words learned in vocabulary lessons^ think learning to write 
letters should be done at a higher grade level, and get nervous when 
called upon in class for fear tliey will appear stupid. In sum, these 
items seem to reflect primarily students' sense of insecurity in being 
able to master some English skills. 



Table 11 Items contained in Factor 9, Insecurity in Mastering English Skills, 
in order of their factor loadings," and percen^ of students agreeing 
with each item by sex and grade. 





Item 
Number 








Grade 




Loading 


Item 


Sex 


7 


8 


9 


10 


.625 


41 


I soon forget words studied in my 
vocabulary lessons. 


M 

F 


56 
49 


S3 
45 


48 


53 
52 


.622 


42 


I thinR learning ^to vnrite letters should 
be done at a higher grade^ level. 


M 

F 


1^ 
16 


17 
7 


v* 

le' 
11 


14 
4 


.435 


31 


I gej nervous when an English teacher 
calls on me in class because I feel 
I will appear stupid. 


M 

F 


44 

47 


42 
45 


40 
46 


36 
49 



The average level of endorsement of these items is about 35 to 40 
percent fpr both bovs and girls and there are no substantial grade trends. 
About half of the students are concerned about remembering vocabulary and 
being called upon in class. 



ERIC 



- 22 



i 
i 

I 



Figure 11 



Average percent of students agreeing with the items making up 
Factor 9, Insecurity in Mastering English Skills, plotted 
separately by sex for grades 7 to 10. 
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Factor XIV - Uselessness of Correai Spelling 



• The percentages of students, by sex and grade, endorsing the single 

item making up Factor XIV are presented in Table 12 and plotted in Figure 

T 

Only about 14 percent of elementary level students agree that 
**It is a useless activity to learn how to spell correctly/* This percent- 
age increases by a statistically significant, but relatively small amount, 
to about 19 at the secondary school level. The vast majority of students 
are, therefore, apparently convinced that it is important to know .how to 
spell correctly. 
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Table 12 Items contained in Factor 14, Uselessness of Correct Spelling, in 
order of their factor loadings, and percent of students agreeing 
with each item by sex and grade. 





Item 
Number 






Grade 


Loading 


Item 


Sex 


7 


8 


9 


10 


.584 


20 


It is a useless activity to learn how 
to spell correctly. 


M 

F 


12 
13 


16 
13 


23 
19 


20 
16 



r 



Figure 12 Average percent of students agreeing with the items making up 
Factor 14, Uselessness of Correct Spelling, plotted separately 
by sex for grades 7 to 10. 
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Tahle*l5 Itqps contained in Factor 15, Noise and Activity in English Classes, 
in order of their factor loadings, and percent of students agreeing 
with each iten by sex and grade. 





Item 








Grade 


1 


Loading" 


Number 


Item 


Sex 


7 


8 


9 


10 


.671 


17 


There is a lot of noise and activity 


M 


38 


38 


52 


53 


in English class. 


F 


36 


30 


43 


50 



Figure 13 Average percent of students agreeing with the items making up 
Factor 15, Noise and Activity in English Classes, plotted 
separately by sex for grades 7 to 10. 
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Factor XV - Noise and Activity in ExigVlsh Qlaeeee ^ . 

The percentages of students, by sex and grade, agreeing with the 
single item which constitutes Factor XV are presented in Table 13 and 
plotted in Figure 13. 

Although at all grade levels a slightly higher percentage of boys, 
than girls agree that ''There is a lot of noise and activity, in English 
classes.", none of the differences at any grade level is st^istically 
significant. . The shif't in percentage of all studepts endorswg this item 
does change significantly, however, from about 36 in grades .7 and 8 to 50 
in grades 9 and 10. 



Sujwnary 

X 

In general, it appears that girls attitudes towards English 
classes and activities are more positive than those* Keld by boys. However, 
on 5* of the 9 factors related to enjoyment of English classes, girls' 
attitudes become sufficiently more negative in high school that their 
attitudes are indistinguishable from those of high school bdys."^ About 
half of the students surveyed agree 'with statements indicating positive 
enjoyment of English classes. 



ATTITUDES TOWARD OTHER ISSUES 

The two factors or scales contained in this cluster are as follows: 
Factor XI contains 3 items-which relate to the ^application of English 
skills to other areas*; Factor XIII, consisting of 2 items, seems to 
• reflect a student ^preference f0r non-reading foms of communication'. 

•it 

Factor XI - Application of English Skills » to Other Areas 

The 3 items comprising this factor are listed in Table 14 and the 
average percentages of students endorsing the items are plotted, separately 
by sex and grade; in Figure 14. 

Students endorsing these items: use complete sentences when writ- 
ing notes to a friend; look up unfamiliar words in a dictionary, and check 
the spelling of words in social studies or science repgrts before handing 
them in. All three items, therefore, seem to represent students' tendency 
to apply the skills they have learned in English in. appropriate ways in 
other areas. * 

As evident in Figure 14, a significantly larger percentage of ^ 
elementary (49%) than secondary students (42%) agree with these items and, 
at both elementary and secondary levels more girls than boys apparently 
apply their English skills in other areas. . ^ 
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Table i4 

• 



Ite;ns contained in Factor 11, Application of English Skills td Other 
Areas, order of tj^eir factor loadings^ and percent of students 
agreeing with jeacji iteni by sex and grade. 




Grade 



Sex 



,610 



34 



When I write notes to a friend, I u 
complete sentences. 



8 9 10 

48 50 41 45 
54 41 43 41 



Do you look up unfamiliar words in a 
•510 59 dictionary when you come across them 

in a book? • 



M 

F 



34 29 _J6 • 25 
43 30"^f7 26 



.454 



35 



Before 1 hand SSpSscial stiidies ot 
scierice report I'^check the spelling 
of wdrds which I think I may have" 
spelled incoi;rectly. 



M 52 57 51 46 
F 74 72 67 64 



A. 



Figure 14 Average perc^t of students agreeing with jthe items making up 
Factor 11, Application of English Skills to Other Areas, 
plotted separately by sex for grades 7 to 10. 
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Factor 'XIII - Preference for lion-reading Types of Corrtrunication 

The 2 items making up this scale, are listed in Table 15 and the 
appropriate sex-grade average percentages are plotted in Figure l5. 

Table 15 Items contained in Factor 13, 'Preference, for Non-reading Forms of 
Communication, in orde^ of their factor loadings, and percent of 
students agreeing with' each item by sex and grade. 





Item 


5 : ^ 

ft 




Grade 


Loading 


Number 


Item 


Sex 


7 


8 


9 


10 


.547 


27 


I prefer to be with people with .whom I 
can express my ideas and opinions; 


M 

F 


00 00 
00 00 


88 
92 


85 
85 


80 
87 


-.465 


68 


Would you rather read a book than watcti 
a television show concerning the same 
subjects? 


M 

F 


14 
22 


13 


12 
15 ■ 


8 

17 















Figure 15 Average percent of students agreeing with the items making up 
Factor 13, Preference for Non-Reading Forms of Communication, 
plotted separately by sex for grades' 7 to 10. 
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" . Students' responses indicate that over 85% of them 'prefer to be 
with people with whom they can express their ideas and opinions* and 
'would rather watch a TV show than read a book on the same subject'. , 

JMthough there are no appreciable sex differences in the attitudes 
reflected by this factor, there is a statistically significant increase 
in the percentage of girls agreeing with these items as one moves from 
^ grade 7 to* the higher grades. 

Swmary 

Students' responses to the items contained in this final cluster 
of two scales or factors suggest that girls' interest in reading and . 
their tendency to apply English skills in other areas is greater than boys 
at all grade levels. The percentages of both boys and girls haying these 
characteristics tends to decline slightly over the grade 7 to grade 10 
interval . 



InterooTvelation of Factors 

In order to discover 'the extent to which the attitudes^ expressed 
on the various -factors are related to one another, the 15 f ac^^ef'><;pre6 
for all students participating in the study were intercorrelated. 

Table 16 gives the intercorrelations (Pearson vs) among the 4 
attitude-toward-reading sciaes and Table 17 gives similar statistics for 
the attitude-toward-English-classes scales. The correlation between the 
two factors compribing the third cluster of factors was .00. 

* * 

I 



*able 16 Intercorrelation of Attitude-Toward-Reading Factors 









Factor 




Factor or Scale 




VILL 




XII 


I 


- Enjoyment of reading 




.36 


.29 


.30 


VIII 
X 


- Critical reaction to 

- Awareness of current 


books i 
literature/ 




.19 


.17 
.20 


XII 

1 


- Access to literature 

9 
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Table 17 Intercorrelation of Attitude-Toward-English-Classes Factors 



Factor or Scale 


Factor 


III 


IV 


V 


VI VII 


IX 


XIV 


XV 


II 


- Enjoyment of English classes 








-46 -^f> 


-10 


-03 


05 


III 


7 Usefulness of grannnar 




-51 


48 


-36 -45 


-06 


-13 


-03 


IV 


- Personal irrelevance of English ^ 






-42 


38 47 
r 


24 


21 


10 


V 


- Enjoyment of writing 








-27 -44 


-08 


-09 


-ov 


VI 


- Difficulty of English 








28 


^ 23 


02 


04 


VII 


- Distastefulness of reading § writing topics 




f 






13 


13 


02 


IX 


- Insecurity in masterj^g English skills 












14 


07 


XIV 


- Us'elessness of correct spelling 














07 


XV 


- Noise § activity in English classes 










9 







As is evident from Table 16, all of the correlations among the 
attitude-toward-reading factors,- though -statistically significant, are 
quite low. Although this indicates that the four scales are measuring 
somewhat different sets of attitudes, it does indicate some real relation- 
ships among them. For example, students who enjoy reading^also tend, to 
a slight degree, to have a more critical approach to books, to 'he TiCre, 
aware of. current literature and have more access to literature • 

The significant interrelationships among the atti%de- toward- 
English-classes factors are primaidly among factors II to VII inclusive. 
Most of these correlations are quite modest in size, ranging from .28 
to .60, indicating a substantial degree of independence of the attitudes 
reflected by these factors or scales. The correlations do, however, in- 
dicate some noteworthy^ though not unexpected relationships. For example, 
students who enjoy English clashes tend to see grammar study as useful, 
find English personally relevant,- enjoy writing, don't find^English 
difficult and are satisfied with the reading and writing topics they are 
assigned. There are few meaningful interrelationships among Factors IX, 
XIV and XV or between any of these factors and any of the others included 
in this cluster. A minor exception is a very slight tendency on the part ^ 
of students who are insecure in their mastery of English skills and/or 
unimpressed with the importance of correct spelling to regard English as 
personally irrelevant. 
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There is only a very modest relationsK^ between students' expressed 
enjoyment of reading and their enjoyment or appreciation of various aspects 
of English classes. (The correlations of Factor I with Factors. II to VII 
range only from -.25 to .39.) 



PARI III A 

In this section of the survey students weye* a*sked to characterize 
English (literature, composition, spelling and grammar) by rating it on a 
semantic differential consisting of 11, 5-point bipolar scales. The mean 
ratings on each scale are plotted in Figure 16, separately by grade. ^ 



FIGURE 16 Mean student ratings, separately by grade, for the 11-item 
* semantic differential relating to 'English'. 

MEAli RATINGS 



Scale ^ Y 

1 My Favourite Qubjeot 

2 Good 



2 Enjoyable 

4 Difficult 

6 Clear 

6 Unnecessary 

7 Useful 

8 Interesting 
Exciting 

10 Fruetrating 

22 Well Planned 



< 




Neutral 
Point 

Grade ? Grade 8 Grade 9 

5j 



My Least Favourite 
Subject 

Bad 

Unenjoyable 
Easy 

• ♦ 

Confusing 

Essential 

Useless 

Uninteresting 

Dull 

Rewarding 



Poorly Planned 
▲ 



Grade 20 



" 31 



Although most of the mean ratings fall fairly close to the .middle . 
or neutral point of the scales, students as a group are inclined to regard 
English as 'useful', 'essential', 'good', 'interesting', 'well planned' 
and 'clear'. While the pattern of students' characterization of English 
is very 'similar across the grades, elementary students are generally more 
positive in their assessment than are secondary students. English, as a 
course, is apparently not a* particularly favoured or disfavoured course 
for these students. 



PART III B ' 

In Part III B students were asked to characterize English text- 
books by rating them on a semantic differential consisting of 8, 5-point, 
bi-polar scales. The mean ratmgs on each scale are plotted in Figure 17, 
separately by grade. ^ 



FIGURE 17 Mean student ratings, separately by grade, for the 8-item 
semantic differential relating to 'English textbooks'. 
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Mo5t of the mean ratings fall quite close to the neutral point 
of tHe scales and there is little difference in the pattern of student 
responses as a function of grade level. In general, students tend to 
rate English textbooks as •boring^ 'flat', 'smart', 'clear' and 'bad'. 
They do not, however, rate them as much 'worse than most others'. 



PART III C 

Section C of Fart III of the attitude survey required students to 
rate each o^six aspects of their English course on a 5-point, like- 
dislike scale. The percentage of students expressing a 'liking' for each 
aspect of the course was calculated by summing the responses of those 
students who checked either of the two scale points on the 'like' side 
of the neutral or mid-point of the scale. These percentages, calculated 
separa^tely by grade and sex, are given in Table 18. The percentages of 
all students liking each-facet of the English program are plotted, by 
grade, in Figure 18. 



Table 18 Percent of Students, by Grade and Sex, Professi/ig a 'Liking' for 
Various Facets of the English Program. 



Facet of the English Program 








Grade 








Total 


7 


8 


9 


10 


7 to 10 


M 


F 


M 


F 


'M 


F 


M 


F 


M 


F 


Literature (novels, stories, poems) 


60 




64 


83 


50 


66 


58 


60 


58 


72 


Writing and Composition 


48 


61 


46 


62 


33 


48 


32 


40 


40 


53 


Spelling and Vocabulary 


40 


60 


42 


59 


25 


26 


21 


27 


32 


43 


Grammar 


29 


36 


22 


4.0 


18 


27 


18 


16 


22 


30 


Discussion 


80 


81 


80 ' 


^78 


59 


69 


68 


71 


72 


75 


Acting Out 


54 


64 


52 


66 


42 


43 


40 


57 


47 


58 


Average Percent 


52 


63 


51 


65 


38 


47 


40 


45 


45 


55 
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It is apparent from Figure 18 that, at all grade levels, students' 
relative preference for various aspects of the English program remains / 
constant. Progressively smaller percentages of students like: discuss-' 
ions, literature, acting out, writing and composition, spelling and 
''vocabulary, and grammar. It is also clear that smaller percentages of 
secondary students like all aspects of the program than dp elementary 
students. This elementary to secondary decline seems to be more pronounced 
for the three least-liked facets of the program. 
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The data of Table 18 indicate that, with minor exceptions, a larger 
percentage of girls than boys, at all grade levels, express a liking for 
all aspects of the English progr^. In the case of 'literature', 'spelling 
and vocabulary*, and 'grannar', the decline in the percentage of girls 
liking these areas is sufficiently dramatic to all but wipe out the boy- 
girl differences at the high school level. 

It is apparent, therefore, that students' enjoyment of English 
^varies dramatically with the particular aspect of the program being studied, 
that girls enjoy all aspects more than boys, and that secondary students 
enjoy all facets less than elementary students. These findings are, of 
course, quite consistent with those derived from Parts I and II of the 
survey. 

In Part IV of the questionnaire students were asked to indicate, 
for each of the six facets of the English program they had just rated on 
like-dislike scales, whether the aniount of class time spent on each was 
•not enough', 'about right' or 'too much'. The percentages of students 
giving each response for each program facet are presented, by grade and 
setr, in Table 19 in the order in which the facets were 'liked' by students. 

It- is evident from the data of Table 19 that more boys than girls 
feel they spend 'too much' class time on all aspects of the English course 
and, conversely, that fewer boys than girls think they don't spenti-enough 
time on'them. It is also mostly true, in keeping with students' responses 
to the items of Part I, that fewer secondary than elementar>' students feel 
they are not spending enough time on each aspect of the English course. 

Generally, students' wish to «pend more time on an aspect of the 
course is correlated with their liking for it. For example, about 50% 
of all students feel that 'not enough' time is spent on 'discussion', the 
most liked facet of the course, whereas only about 25% of all students 
feel 'not enough' time is ^pent on 'grammar'', the least liked aspect of 
the course. 

The pattern of students' responses to 'spelling and vocabulary' 
and 'grammar' is somewhat different from the pattern of their responses 
to the other items. With respect tp these two items students seem to 
become increasingly divided, a larger percentage of secondary than elemen- 
tary students suggesting both that 'not enough' and 'too much' time is 
spent on them in class. < With the other four items, if a larger percentage 
of students judge 'not enough' time is spent, a correspondingly lover per- 
centage of students judge 'too much'. This seems to indicate that, in the 
case of 'spelling and vocabulary' and 'grammar', an increasing, though 
relatively small, percentage of students feel that more time should be 
spent on these subjects, even though they are least liked. 
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Table 19 Percentages of Students, by Grade and Sex, Wio Indicated That 
the Amount of Time Spent on Six Facets of the English Program 
Was Either 'Not Enough', 'About Right', or 'Too Much'. , 





























The 


amount of- class time spent on 


discussion is. . . 




Not Enough 


About 


Right 


I 00 


Much 


Grade 


Boys 




Girls 




Boys 


Girls • 


Boys - 


Girls 


7 


60 






57 




30 




36 


9 


7 


> o 


67 






65 




27 




29 


7 


6 


" Q 


43 






39 




39 




51 


16 


9 


10 


49 






48 




36 




40 


12 


12 






The 


amount 


of class time 


spent on 


literature 


is. . . 




















^ 




7 


18 






21 




67 




67 


14 


12 


fi 

o 


18 






26 




63 




65 


18 


9 


q 


16 






21 




50 




58 


31 


20 


10 


19 






9 




57 




59 


22 


31 






The 


amount 


of 


class time 


spent on 


acting out 


is. . . 




59 






68 




25 




22 




8 


fi 
o 


60 






75 




19 ' 




21 


21 


4 


Q 


35 






42 




38 




38 


24 


19 


10 


30 






47 




41 




39 


25 


13 




The amount 


of class 


time spent 


on writing & compos 


ition is. . . 


_ 

/ 


29 






31 




52 




.56 


18 


14 


Q 
o 


23 






27 




56 




55 


21 


8 


q 


17 






21 




■ 50 




65 


30 


12 


10 


14 






29 




■ 57 




48 


25 


24 




The amount 


of class 


time spent 


on spelli 


ng & vocabulary is. . . 


7 


12 






14 




63 




69 


25 


16 


8 


14 






17 




68 




- 67 


18 


16 


9 


22 






27 




.44 




52 


32 


19 


10 


24 






33 




46 




45 


27 


21 






The 


amount 


of 


class time 


spent on grammar is 




•7 


9 






13 




61 




64 


29 


22 


8 


• 15 






19 




54 




52 


30 


29 


9 


' 12 






28 




48 




47 


37 


23 


10 


21 






27 




47 , • 




46 


29 


26 
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PART V 

ATTITUDES AND AREA OF COURSE CONCENTRATION 

♦ 

"In this, section of the survey^ secondary students i^ere* asked to 
indicate in which area (academic, commercial, technical, other)-^eir 
courses were most heavily concentrated. Because the percentages of stu- 
dents concentrating in e^h. area is related to their sex, and because 
there are known sex difrereiices in attitudes toward English (Pa'rts I 
II), the data relating area' of concentration to attitudes toward English 
were examined separately by sex. In each case, students were sorted into 
groups based on their area of concentration and their scores on the 15 
factors isolated iji Parts I § II of the survey compared using one-way 
analysis of variance and Scheffe tests. 

Boys attitudes varied by area of concentration on- only 2 of the 
15 factors and the differences among groups were relatively small (p < 
•05). Boys concentrating in the academic program scored higher on Factor 
XII, access to literature, than the other groups. Boys in 'other' programs 
found English classes less relevant (Factor IV) than those in other groups. 

Girls' attitudes varied, si^ificantly by area of concentration on 
.10 of the 15 factors and most of the differences were fairly marked, 8 of 
the 10 F ratios being very significant statistically. Although girls 
concentrating in commercial, technical and other programs did not differ 
often among themselves, they did respond quite differently than girls* in 
the academic program. The 'academft* girls displayed the most positive 
attitudes of all groups on 3 of th^ 4 factors (I, VII § XII) related to 
attitudes toward reading and 5 of x%e 6 factors (II, III, IV, V, VII § 
IX) related to attitudes toward Enfiish classes. They were also the most 
likely to apply English skills in cfher areas (Factor XI). 



I 
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ATTITUDES AIW NUMBER OF ENGLISH TEJ^EERS 

Elementary students were aiked to indicate how many different 
teachers (1, 2 or 3) taught them various aspects of English during that 
academic year. Using their responses to this question, students were 
partitioned into three groups and their scores on the 15 factors derived 
from Parts I § II compared. Differences among the three groups were 
found on only 1 of the 15 factors/viz. , insecurity in mastering English 
skills. Students who had three different English teachers were more 
confident of thejjr skills than stadents who'had either one or two differ- 
ent teachers. The difference, however, was slight and the size of the 
'three-teacher' group relatively si^ll (14% of all elementary students). 

J 

P^RT W 

In oVder to summarize students' opinions about the books they 
studied in literature, a simple count was made, separately by grade level, 
of each time a book- was lifted by^e students as either l^d or disliked. 

( 
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The .books were then listed in order of the number of nominations each 
received. (Although these lists are not included in this report, copies 
are available to the interested reader.) 

Over 85% of students nominated one or more books as being liked. 
At any one grade level students as a group listed from 94 to 133 different 
books." However, no one book was listed as liked by -more than 40 or 13% 
of students at any grade and about 90% of the books were nominated by 
fewer than 10 students. 

About 72% of students listed one or more books as being disliked, 
At any one grade level they listed from 57 to 93 different disliked books. 
No one book, however, was listed by more than 19 or 7% of students at any 
gride level. Over 90% of the disliked books were characterized as such 
by fewer than 10 students. 

It appears quite clear, therefore, that student tastes and pre- 
ferences in literature vary widely and that no one limited selection of 
books could please the majority of students. It is perhaps reassuring . 
that 85% of students liked at least one of the books they studied in 
literature classes. ^ 

Student responses to a request for suggestions for additions to, 
or deletions from the^English program were tabulated under a series of 
arbitrary content categories developed by examining a sample of their 
responses. The percents of all responses represented by each suggestion 
for additions to the program were calculated, separately by grade level, 
and are presented in Table 20 (p. 39). Similar calculations for suggested 
deletions are displayed in Table 21 (p. 40). 

The content of these two tables tends primarily to reflect students' 
responses to Parts I and II of the survey amd will not, therefore, be 
coiranentfed upon further. 

Students' responses to the request 'Tell us something.' provided 
a great range of amusing and instructive comments, most of which, however, 
represented elaborations or re-statements of opinions given in other parts 
of the questionnaire. A sampling of students '> conments, unedited with 
respect to spelling, grammar, punctuation, etc., follows. 

The English progrcame ie good but it's to boring. 
Extra courses like drama or else a free period would be okay. 
It needs more zip to it. (grade 7) 

English is one of my 'best subjects, but I feel that I 
could do better if we had one teacher, instead of three. They 
each have different op^inions, and they often overlap. (grade 8) 

I 'think English is pretty good this year (grade 9) ^ . 

, I liked Mrs. X my English teacher. She was a panic and 
got her point across to us. (grade 9) 
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As you probablyl^naui^ I love English. I wish to be a 
part tine authjor when I grow up. I read books because I enjoy 
them net because I have to. Reading gives a good imagination 
but watching a stupid television doesn't. I don't see what ^ 
people see in a Z.V. It takes away the imagination. If you 
read books you can't become addicted to T.V. Thi^ is sort of 
a weird topic to tell you about but then, I'm just naturally 
odd, and I love it'. (grade 10) ^ 

I like Literature better then EngVish because. Engl vsh - 
is to hard because of all the thinks y<}u have t& remeber%n 
English (grade 7) ^ , ^ - 

English is boring, it stinaks. . (grade 10-) 

English isn't to excieting, some of it is sensless. . 
Grammar is boring 4 it drag$ on S on S on. I like writing 
stories S poems S having disscousions, which we do not do 
enough of^ its always, Gramar S spelli^. (grade 8) 

I like most of the stuff except a coUpU ofcbooks and 
grarmer (grade 10) ^ ' ^ o 

English stinks ^(grade 8) 

I hate doing ^ grarmar every day when its so easy for me 
but all: the- rest of the class can't understand it. I have to 
sit through the teacher's boring explanation. (grade 7) o 

Hi: (arade 10) 

Gramar is to ham to understand. (grade 8) 

Grammar and writing ^a-nd composition bor^ metijp deat'h.* 
I Muld rather have more acting out and read way moy'e Hovels 
that we are allowed to pick out*' ourselves. ^ (grade 10) 

I hate English (grade 3) , 

I think English is- good to help other people to speak 
right- and talk clearly. ) (grade 10) 

English in our school is boring. For I feel that we 
do not write enough short stories or act out enough plays. ^ 
Instead 'We have too much spelling. I think that boys and 
girls would enjoy ^ this subject more if thtty do more what they 
want to do instead of having the teacher give us strict orders, 
(grade , - ^ 

It depends on the teacher what kind of class its going 
to'* be. (grade 10) . - " 

I believe thai students should 'be giveri a greater 
chance to show their creative ability 'in writing* If 
envolvement is nill the in take of knowledge will be alsd. 
(grade 8) ^> 
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I don't think the lunch ours should be so short 
because bye the time I get hom I hccoe aboat ten muniutes to 
eat. (grade 7) 

The English program is pretty good as it is but it 
can be better (grade 10) i ^ 

I Believe that the' English I study now is teaching me 
alot about life I think too^ that the English teacher I have 
now is the best I've ever had and she makes English enjoyable 
and educational for us. (grade 9) 



Table 20 , Students' responses,* by grade, to the question "What would you 
like to see added to the English program?'*, eicpressed as a per- 
cent of all responses given. 





Grade 


Student Response 


7 


8 


9 , 


10 


Teacher 


.3 


1.0 


3.8 


2.9 


Relevance, life, personal involvement 


1.0 


1.3 


1.1 


1.3 


Sports stories 










Field trips 


1.0 . 


1.3 


2.3 


2.9 


More time % , 


1.4 


2.3 






More time to write on your own topics 


1.4 








Interesting assignments 


1.7 








More interesting, mystery stories 


1.7 








Redding in class 


1.7 








Mas^ media, radio, TV, films 


2.7 


- 5.2 


8.4 


9.6 


More reading books 


2.7 








Poetry 


2.7 


2.9 


1.5 


5.8 


Better texts and materials 


3.8 


' 4.2 


.8 


.3 


Vocabulary, spelling, grammar ^ 


4.5 


2.6 


' 5'. 3 


6.1 


Composition and writing 


7.-2 


5.8 


4.9 


5.1 


0 

Novels 


10.3 


1.6 


12.9' 


11.2 


Discussions 


12.0 


12.9 , 


12.2 


13.5 


^ Acting and Plays 


20.2 . 


19.7 


14.1 


12.5 


Nothing 


22.6 


15.2 


8.7 


7.7 ■ 


Total suggestions 


292 


310 


263 


312 


Number of students not rjesponding 


51 


54 


49 


56 
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Table 21 Students' responses, by grade, to th^ question "What would i^u 
like to see -deleted from the. English prdjtam?", expressed as a 
percent of all responses given. 







. • Grade 




, Student Response 


7 


8 


9 


10 


Tencher 


.4 


1.2. 


1.5 


8.6 


Book reviews 


.4 


.0 ^ 


3.4 


* 

2.7 


" Acting 


.8 " 


.8- 


8.5 


6.6' 


^ Homework 


1.6 


.0 


.9 


1.6 


Literature ^ ^ 


2.0 




•0 


".8 


Memory work #• 


2.4 


.•8 


2.1 




Poetry 


4.1 


2.0 


9.0 


12.5 


Spelling § vocabulary 


4.9 


5.3 


5.1 


'"'3.5 


Reading texts \\ 

* • 


Q X 


8.1 


8.1 


8. 9 


Composition § wiitiH^. i 


10.2 


8.1 


4.5 


6.2 


Grammar - detailed aspects 


9.8 


no.i 


1.3 


.0 


Grammar - all * -^^ 


16.7 


?1.0 


14. l' 


. 17.1 


Everything^ 


1.6 


,l?o 


2.6 


1.6 


Nothing 

■ 1_ 


28.9 


2^.7 


12.0, 


10. 1 


Total suggestions ' 


246 


247 ^ 


234 


257 


Niunber of students not responding 


68 


76. 


67 


87 













MAJOR FimxNds « ^ . 

The mam findings of this study, -derived from the 'data contained 
in the 18 figures and 21 tables of this report, are summarized in point 
f©rm jpelowi 



Attitudes Toward Reading 



1. Students, especially girls, are fairly positive in their'* » 
attitudes toward non-requii^ \feading. It^appears to ^e an ei;jjoyable . 
pastime frpifi which they gain sqmething worthwhile!. % 



... ""^6 disconcerting drop in boys* :enjoyment of reading at the 

high school level may be due to the incteased competiUon it has with 
other attractive social activities andT their concern with activities ' 
for establishing their masculine identity.. 

2. Roughly one-third of students (tend to take a critical attitude 
toward their reading and h^ve a si«nificauHersonal involvement^ in it. 

3.. Popular reading seetos to l;ave more appeal for secondary 
students. .- r 

■ ' With regard to the newspaper: over S0% of students do read 
It; boys rpad it more than girls; the higher the grade level the more 
popular reading the newsp'apei-beicomes . These findings should be consid- 
ered in future curriculum development. 

4. Boys appear to subscribe to magazines more 'frequently than 
girls. There is a definite elementary-secondary shift in the reading, 
interest^ of boys toward popular reading mirterials (magazines, newspapers) 
and away from more serious, hard-copy books. 

. Enjoyment of English Classes 

1. Students probably enjoy English classes as well or better 
than they do most other classes. 

2. Whereas boys' enjoyment of English classes tends to increase ■ 
with grade level, there is a marked elementary to secondary decrease in 
•girls'- enjoyment of them. H 

3. Students appear to want a' high degree of active participation 
19 class activities, e.g. discussions, within an English classroom that 
has a warm, open atmosphere. ^ 

4. The pattern of students' responses to several items suggests 
that they respond more .positively to the climate and methods used in the 
classroom ^hSir they do to the content (grammar, spelling'; novels, etc.}. 

5. While a substantial majority of students feel that grammar 

IS both useful and neceslary, they find it distasteful. This 'unpleasant- 
ness may be du^ to: repetitioif", unimaginative methodology, a prescrip- 
tive, latmate apprdach to grammar, the lack of a, well-defined and under- 
stood languaj^ curriculum" and a failure -to transfer the 'rules' of writine 
successfully in practice. • ' • , 

> 6. About two- thirds of the students feel that English is useful 
relevant and important > ' 

' 7 Although girls consistently enjoy writing more than boys, there 
IS a, significant deci:ease in. their enjoyment at the high school level. The 
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differential enjoyment of writing between boys and girls may be due to the 
particular stereotype associated with interest in English. 

8. At the secondary level girls seem to find high marks difficult 
to attain and they are less pleased than their elementary counterparts 
with their accomplishments in English. This lessened 'achievement** Say be 
p^irtly responsifele for secondary girls' decreased enjoyment of English. 

English study tends to bf perceived as a relatively satisfy- 
ing experience. * ^ 

9. A significant majority of studentS-, especially secondary school 
girls, find literature content boring. About ^one-half of students feel 
that assigned writing topics are lacking in relevance and interest. 

«. • . < 

10. Over half of students- find little transfer of words, studied 
in xo€.^iilary lessons to their working vocabulary. 

11. Although an over^ghelming majorit)^ of students regard correct 
spelling as useful and necessary, it is one of the least liked facets of 
the English program. A^ careful review of methods of teaching spelling 
is obviously in order. 

12. L^ss than 50% of students consciously apply English writing 
skills when involved' in writing activities unrelated to their English . ^ 
courses. 

13. .Although reading books apparently suffers in competition with 
watching television, television has not yet displaced reading as a student 
activity. 

14. Jhere is only a modest relationship between students' 
attitudes toward reading and their -attitudes toward English classes. 

Attitudes Towards Various Facets of English 

1. Students have well-defined preferences for various fac^^ of 
the Engli'Sh program. Jhese preferences are constant throughout tllipgrades. 

• • ^ 2. Those parts of the program which are more likely to be taught 
mechanically and involve rote learning are least lik^ (spelling, vocabulary, 
grammar) . ' • . • 

3. Parts of the English program which allow a high degree of 
student participation are liked best (discussion, literature," acting out). 

4. HTiile thfere is a general ^line in 'liking' for all aspects 
of the program over the grade 7 to 10 spK^ the decline in liking i^ 
someJwhat more pronounced for spelling, vo.cabulary and grammar. 
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5. Generally speaking, the more students, like a particular facet 
of the English program, the more time they* want to spend on it. 

6. There ds sufficient lack of consensus among stwfflents in 
their likes and dislikes of reading materials that no one selection of 
books for a course can please a majority of students. The implications 
,of this finding for instruction in literature are very important. 

Student Suggestions for Additions or Deletions 

1. Students' response to the request for suggestions about 
additions to, or deletions from the English program show that secondary 
students have a less positive attitude toward English than elementary 
students. 

This increasingly negative attitude may be related to: 
increased demands of the courses; a njore critical attitude toward both 
teachers and courses, and a desire for more creative and imaginative 
teaching' strategies . 



SUMMARY 

* ' 

A. questionnaire designed to assess students* attit^es toward 
various aspects of the English program was administered to a 10% random 
sample of students enrolled in grades 7 to 10 inclusive. 

The results indicate marked differences in the attitudes of boys 
-and girls and systematic trends acrossythe grades. Many of the findings 
suggest the neep for significant revisions in course content, emphasis 
andl methodology. 

/ 



/ 
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'INTERMEDIATE ENGLISH EVALUATION PROJECT: / 
SURVEY OF TEACHERS 



R. G. Stennett 5 Loma Isaacs 
Educational Research Services 

Research Report 74-05 

1 

This survey constitutes one of several major components in an over- 
all evaluation plan designed to assess the current status of London's Inter- 
mediate Engli$h program and to produce recommendations for future develop- 
ments in curriculum and methods. The project is led by a Central Committee^ 
composed of the consultant in English, an administrator from Curriculum and 
Planning, elementary and secondary teacher representatives and support staff 
from Measurement and Evaluat^ion and Research Services. Ad hoc subcommittees 
of educators have contributed to various aspects of the work. 

After an initial series of organizational anS planning meetings 
separate surveys. were undertaken to assess community and student attitudes 
toward various facets of the Intermediate English program. A group of 
educators has devoted substantial effort toward defining and specifying 
the gi&ftis and objectives of the program in terms of the broad areas, as 
establishe^i^ by NCTE,^ of Reading^- Writing, Speaking and Listening. The 
<?Clrrent survey attempts to elicit English teachers* views and opinions. 
A fairly large-scale sunfey of student progress in achieving some of the 
major goals of the program vsill be completed during the spring term of 
1974. 

When all of the surveys have b€5erv completed, a larger and more 
broadly repre5entative committee will 6e established to review all of the 
findings and formulate recommendations for the senior administration and 
Board of Education. 
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^ I'fETHOD 

Construction of the Teacher Survey 

After an initial draft of the Survey had been created by the Central 
Committee, it was presented to a group of teachers^ for critical review and 
editing. The edited version consisted of 30 items or sections, divided into 
three parts. Part I consisted of 14. items in terras of which teachers were 
able to describe briefly their backgrounds, experience, qualifications and 
situations. The 14 items of Part II enabled teachers: to describe their 
instructional activities lii terms of the degree of emphasis they give to 

^Mr. L. Dickie, Mr. G. Sleightholm, Mr. N. Kaite and Mr. G. Clift. 
^National Council of'Xeachers of English 

^The Committee would like to thank the following ?hachers who helped with 
this aspect of the project: Mrs. J. Bradford, Mrs. E. Holt, Mr. T. 
McClenaghan and Mr. J. Zeeman. 
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certain facets of the program; to rate the adequacy of instructional aids, 
and to express their attitudes about teaching English. lA the final section 
teachers were simply, asked to list the major strengths and weaknesses of the 
Intermediate English program. 

In order to encburage as open and candid responding as possible, the 
teachers were not asked to identify themselves on the survey form. 

Zistrn-butior, of Survey and Returns 

The survey was distributed near the end of November, 1973, via the 
school system's own mail service, to all teachers teaching English in all 
grades from 7 to 10 inclusive. A followup mail request for return of the 
questionnaires was made in mid-December, 1973. In addition, verbal requests 
were made when possible by Central Committee members through departtient heads 
or other school-level representatives. One hundred and ninety-five or 58% 
of the 339 forms distributed were returned. The return rate was slightly 
higher at the secondary (74/117 or 63%) than at the elementary (119/222 or 
54%) level, possibly because of the greater ease of contacting teachers 
informally at the secondary ^evel. ^ 

Data handling and Analysis m 

\ Data from the survey forms were coded, punched into data cards and 
tabulated by computer. Teachers' wTitten comments concerning the strengths 
and weaknesses of the program were assigned to broad content categories 
developed from an examination of their responses., J 

The basic statistical procedures consisted of calculating means, 
standard devi^ions and percentage frequency distributions for each of 
124 variables, separately for elementary and secondary teachers and for 
all teachers. In addition, 80 variables were intercorrelated using data 
for all teachers. 



RESVUIS 

Since the major purpose of this paper is simply to describe the 
characteristics, teaching styles and attitudes of Intermediate English 
teachers, the results will be presented in tabular form with a minimum of 
interpretation. HTien fairly obvious patterns of responding are evident in 
the data, they will be called to the reader's attention. 

Because all teachers did not answer all questions or every, part of 
each question, the number of cases on which the various calculations were 
made varies. For this reason the number (N') as well as the j)ercentagfe of 
teachers giving each response to each part of each survey question is pro- 
vided in most tables.' Since there are differences in the situations of 
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elementary (grades 7 and 8) and secondary (grades 9 and 10) teachers, 
the tables generally give the results separately for, each group as well 
as for both groups combined. 



CHARhCTERIi 



SITVATIOUS AND PROFESSIONAL ACTIVITIES 



Expeirience 

Table 1 gives the breakdown of the faculty teaching Intermediate 
English by sex, separately for elementary and secondary levels. The 
relatively large percentage of teachers who, did not respond to this item 
is due in part to a fault in the format of the survey form as well as a 
feeling expressed by some respondents that this information was irrelevant. 

It IS apparent from these data that Intepediate English is taught 
primarily by men (75%) and that the proportion of men teachers is somewhat 
higher at the elementary (84%) than at the secondary level *(62%) . 

All of the statistically significant correlations between sex and 
other items in the survey are quite small (.17 to ,28) and represent only 
very slight relationships. 

TABLE 1 Number and Percentage of Teachers by Sex, 
Separately for Elementary and Secondary 
Levels. 



Sex 


Elementary 


Secondary 


Total 


N 


% 


N 


% 


N 


V 


Male 


84 


69 


37 


.50 


, 121 


62 


Female 


16 


13 


23 


31 


39 


20 


No Response 


21 


17 


14 


19 


35 


18 


Total 


121 


99 


74 


100 


195 


100 
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Table 2 gives a breakdowTi of teachers by the grade fs) at which they 
are currently teaching. A somewhat larger proportion of secondary tgadi^rs 
teach at more than one grade level than do elementary teachers, but the 
difference is not large (45% vs 35%). 

Table 3 shows the grade level? at which teachers have taught during 
their careers. Although English teachers have had most of their experience 
in the panel in whi<:h they are currently teaching, a fairly significant 
'percentage of secondar>' teachers have also had experience at the elementary 
level. In contrast » very few elementary teachers have had secondary school 
teaching /experience. 

1o 



TABLE 2 Number and Percentage of Teachers by Grade (s) 
Taught . 



Grade {^) 
Taught 


Elementary 


Secondary 


Total 


N 


0 
0 


N 




N 


% 


1 


3" 


• 

31 






37 


19 


- 0 8 


42 


35 






42 


22 


i § 


42 


35 






42 


22 


! 9 






22 


30 


22 


11 


9 Q 10 






33" 


45 


33 


17 


10 






19 


26 


19 


10 


Total 


121 


101 


74 


101 


195 


101 



TABLE 3 Teachers Experience m Terms of the Grades 
They Have Taught During Their Careers. 



Grades 
Taught 


Elementary 


Secondar>' 


N 


% 


N 


a 

'o - 


K 


3 


2.5 


1 


1.4 


1 


22 


18.2 


3 


4.1 


2 


23 


19.0 


5 


6.8 


3 


31 


25.6 


6 


8.1 


4 


50 


J1.3 


6 


8.1 


5 


87 


71.9 


9 


12.2 


»6 


113 


•>3.4 


11 


14.9 


7 


120 


99.2 


13 


17.6 


8 


110 


90.9 


13 


i7.8 


9 


6' 


5.0 


72 


97.3 


10 


4 


3.3 


73 


98.6 


11 


1 


.8 


64 


86.5 


> 

'12 


1 


.8 


59 


79.7 


13 


1 


•? 


37 


50.0 
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^ the data of Table 4 indicate, Intermediate English teachers 
average about 9 years English teaching experience with fewer than 21% 
having taught less than five years. Elemental' teachers have been teach- 
ing English somewhat longer on the average (10.19 years) than secondary • 
teachers (7.26 years) and tliere are proportionally^ fewer elementary (16%) 
than secondary {39%) teachers with less than five years experience teach- 
ing English. 



TABLE 4 Number and Percent of Teachers by Years of Teaching 
English, Separately for Elementary and Secondary 
School . 



Years of Teaching 
English . 


Elen^ntary 


Second ar)' 


Total 


N 




N 




N 


% 


I, 2 


8 




15 


18 


21 


11 


3, 4 


10 




15 




25 


13 


.5,6 






12 


17 


28 


1 

15 i 


•". 8 


19 






8 






1 ' 

.27 


1 

14 : 


9, 10 


16 


14 


10 


14 


1 

26 


14 ' 


11, 12 


12 


10 


4 


6 


16 


8 


13, .M. 


15 


13 


6 


8 1 21 


11 


15, 16 


5 


4 


1 


1 


6 


1 

3 


n, 18 




6 


1 


1 8 


4 


19, 20 


4 


3 


0 


0 


4 


2 


>20 *■ 


6 


5 


3 


4 1 


9 


5 


Average 


10.19 


-T 

/ 


.26 


9 


.03 



Sveoializazion 

< 

Table 5 gives a distribution of teachers by current or intended 
major subject area. It is quite obvious that while the majority (89%) of 
secondary teachers who teach English major in that area, only a minority 
of elementary teachers {21>%) do. 
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TABLE 5 Number and Percent of Teachers by Major Subject Area 



Major Subject Area 


ElemeTitarx 


Secondary 


TotaJ 


N 


\ % 

1 ^ 


N 


% 


N 


% 


English 


26 . 


r' 23 


66 


89 


92 


49 


Geographv 


• 21 


18 


1 


1 


22 


12 


: fiistoT- 


14 


12 


r 

- 2 


3 


16 


8 


; Physical Education 


11 . 


. 10 


1 


1 


12 


6 


Science. 


12 j 




■ 

0 


0 


12 


6 


Mathematics 


5 


4 


0 


0 


• 5 


3 


^ * *'k)dem Languages 


1 


1 


3 


4 


4 


2 


i ^•tusic 


3 




0 


0 


3 


2 


; * ^rt 


5 




0 


0 


3 ! 2 


' No Specialization 


10 


9 


0 


0 


• \ 

10 ; 5 


f 7^ 

Other 


S 




1 


1 


9 


5 



Table 6 gives the number and percent of teachers by the subjects 
they are teaching this academic year and Table 7 sunssarizes these data to 
highlight the extent to v^hich teachers' instructional work is concentrated 
m English. It is quite apparent that, while most secondar>' teachers (82%) 
involved in English instruction teach only that subject, almost all elemen- 
tar>* teachers provide instruction m other subjects as well. Over three 
Quarters of the elementary teachers .teach both mathematics and English. 



TABLE 6 Number and Percent of Teachers by Subjects Taught 
During the 1975-74, Academic Year 



Subjects 

Taught 
This Year 


EleEentary 


Secondary 


Total 


\' 


% 


N 


% 


N 


% 


English 


121 


100.0 


74 


100.0 


195 


100.0 


Vathematics 


92 . 


76.0 


1 


1.4 


93 


47.6 


Geography 


43 


3S.5 . 


1 


1.4 


44 


22.5 


P.E. 


41 . 


33.9 


2 


2.7 


, 43 


22. 1 


History 


40 


33. 1 


3 


4.1 


43 


22. 1 


Science 


38, . 


. 31.9 


0. 


0.0 


38 


19.5 


Art 


35 


28.9 


0 


0.0 


55 


17.9 


Music 


11 




0 


0.0 


11 


5.6 


Modems 


8 


6.6 


2 


2.7 


10 


5. 1 


Other 


2 


1.7 


2 


2.7 


4 


2.0 
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TABLE 7 Distribution of Teachers by the Degree to Which Their Instructional 
Work is Concentrated on Teaching English. 



Concentration On 
Teaching English 


.Elementary 


Secondary 


Total 




N 


% 


N 


^ % 


N 




i 


English 5 3 or more subjects' 


57 


47.1 


2 


2.7 


59 


30. 


3 


English § 2 other subjects 


35 


28.9 


0 


0.0 


35 


18. 


0 


English § 1 other subject 


28 


23. 1 


11 - 


14.9 


' 39 


20. 


0 


English Only 


1 


.8 


61 


82.4 


62 


31. 


7 



Table 8 gives teachers' estimates of the amount of time they devote 
to English instruction each day. These data reflect the degree of special- 
ization in instructional activity evident in Tables 6 and 7.* It is also 
apparent that elementar>' students are exposed to considerably /^mo re instruc- 
tion in English per day than are secondary students. 

TABLE 8 ^Distribution of Teachers in Terms of Their Estimates 

of the Amount of Instructional Time Devoted to English 
Each Day. 



Minutes/Day 
Teaching English 


Elementary 


Secondary 


Total 


.N 


% 


N 


% 


N 


% 


0 - . 30 


1 


0.8 


0 


0.0 


1 


■ 0.5 


31 - 60 


20 


16.9 


2 


2.7 


22 


_11.5 


61 - 90 


53 


44.9 


5 


6.8 


58 


30.2 


91 - 120 


26 


22.0 


1 


1.4 


27 


14. 1 


121 - 150 


3 


2.5 


1 


1.4 


4 


2.1 


151 - 180 • 


7' 


5.9 


5 


6.8 


12 


6.3 


181 - 210 


3 


2.5 


3 


4.1 


6 


3.1 


211 ' 240 


0 


0.0 


57 


77.0 


57 - 


29.7 


>240 


5 


4.1 


0 


0.0 


- 5 


2.5 


Average 


103.42 


213.78 


145.96 



^%ia lificat i ok s 

Table 9 gives a distribution of teachers by highest certificate 
held and Table 10 shows their additional qualifications. The number and 
percent of teachers having various t>T5es of administrative responsibilities 
are shown in Table 11. 
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TABLE 9 Distribution of Teachers by Highest Certificate Held 



Elementary 


Secondary 


Teaching 
Certificate 




^ 


Teaching 
Certificate 


N 


% 


Standard 1 


1 


0.8 


Interim B 


3 


4. 1 


Standard 2 


9 


7.4 


Permanent B 


• 23 


31.1 


Standal^d 5 


26 


21.5 


Interim A 


12 ■ 


16. i 


Standard 4 


85 


70.2 


HSS 


36 


48.6 


■ '1' 

Totals 


121 


99.9 


Totals 


74 


100.0 



TABLE 10 Distribution of Teachers bf Additional Quafifi cat ions 



» 

Additional Qualifications 


Elementar)' 


Secondary 


Total 


N 


% 


N 


% 


N 


% 

■ * — 


Department Certificate 
i in Language Arts, 
Theatre .Arts, Drama, 
University English Courses 
. B.A. , M.A. , M.Ed. 


26 


22 


IS 


21 


41 


21 


Public Speaking, T.V., 
Film, Library, Reading, 
Department Certificate 
in English 


6 


5 


6 


8 


12 


6 


None 


89 


74 

• 


52 


71 


141 


73 



TABLE 11 Number and Percent of Teachers Having Various Adminis- 
trative Responsibilities. % 
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Administrative 
Responsibi lities 


Elementar>' 


Secondary 


Total 


N 


% 


N • 


% 


N 


% 


Principal 


3 


2.5 


0 


0.0 


3 


1.5" 


Vice-PJ^incipal 


21 


17.4 


: 0 


0.0 


21 


10. 7 


Department Head • 


3 


2.5 


■ 16 


8. 1 


9 


4.6 


Assistant Head 


0 


- 0.0' 


11 


14.9 


11 


5.6 


Other 


11 


,9.1 


7 


jL 


18 


9. 2 



^""^ ^"^^^^sional /Activities \ 
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Table 12 shows the number and percent of teachers belonging to 
various English-related professional organizations. Apparently only a 
small minority of Intermediate English teachers participate in such 
organizations. 



TABLE 12^ Number and Percent of Teachers Belonging to Various English-Related 
• Professional Organizations. : 



Menijership in 
Professional Organizations 


■Elementary 


Secondary 


Total 


Nf 


% 


N 


% 


N 


% 


Ontario C.T.E. 


0 


0.0 


9 


12.2 


9 


4.6 


National C.T.E. 


1 


0.8 


3 


4.1 


4 


2.0 - 


Canadian C.T.E. 


1 


0.8 


9 


12.2 


10 


5. 1 


International Reading Assoc. 


5 


4.1 


4 


5.4 


9 


' 4.6 



The extent and patterning of teachers* reading of various English- 
related periodicals is shown by the data of Table 13. A tabulation of the 
number of different periodicals read regularly by teachers is given in 
Table H. 



TABLE 13 Number and Percent of Teachers Regularly Reading Various 
English-Related Periodicals. 



Periodicals 
Read Regularly 


Elementary 


Secondary 


Total 




S 


N 


% 


N 


% 


Elementary English 


12 


9.9 


0 


0.0 


'12 


6.2 


. Media 5 Methods 


0 


0.0 


9 


12. 2 


9 


4.6 


Monday Morning 


14 


11.6 


7 


9.5 


21 


10.8 


English Exchange 


1 


0.8 


'20 


27. 0 


21 


10.8 


English Journal 


2 


1.7 


23 


31. i 


25 


12.8 


Reading Teacher 


12 


9.9 


4 


5.4 




8.2 


Other 


5 


4.2 


12 


16. 2 


17 


8.7 
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TABLFi 14 



Distribution qf TeacKers by the Numlier 
English^Related Periodicals* They^ Re$-d 



•of Different 
Regularly. 



No. of' Periodicals 
# Read Regularly 


Elementajrx 


^, Secondary ,' 


4 

' Total - 


N - 


0, 


N 


• ^-^ 

■ 0 






■. . • 0 


88 


J2.7 


34 


45.9 


1^2 


■ 62.5 


1 


2f 


18. i 




24.3 


. 40 


20.5 


2 


9 


7.4 : 


16 - 


21.6 . 


25 


12.8^ 


3 


- 2 


1.7 


3' 


•4.1 


■ 5: 


V . 

• 2.6 




T 


■ o.o' 


2 


f 

• -2.7 


2 


1.0 . 


1 — a 


0 " 

■ — iT" ' ' ' 


"0.0 


1 


'l.4 


1 


.5 



^Table.rs give^ the average number of fiction and .non-fiction books 
^* I** * read each year", separately 'For elemenfary and . secondary teachers, vyhile 
secondary teachers read someWhat more than el^mentary^ teachers ^o, both 
^ ^ ' groups obviously do con^derable reiding, -a subst,antiai portion of which 

, consists' of non-fiction works. , * 




TABLE 15 



Average 'Number )f fiction and- Non-fiction 
Books Read Per^ i^ear by Elementary and ^ 
Secondary Teach ji^s. -'^ , 





A^^S^&ge Nuin)!>er*' of 'BoWs i 
ij^ ''^^ Read Year- ^ ^ 


■^Elemgntary 


Secondary 


Fiction 


- 15.38 


25.01 


Non-fic^^n T 


>• . 10.78 


11.51 


- Total - 


24. £5 


-34^37 



As th^'data of Table 1,6 i^^icate-, the majority (62%) of elementary' 
teachersydo not feel they ar^^ able to attend as many iti-servdce training 
ses&^fchs a^*they would Jike! Although mbsl secondary ^teachers (S8%) feel . 
they are able to attend" enoug^J^ in-service sessions, a signjfi^cant minority 
do not;^. ^v'^r'half of all teatghers feel a need ^or more in-service training. 



TABLE lb Teachers* Responses to the Question: *Are yoiYabl* tp 
I ^ . 'attend as' many English'^^n-service* training sessions 
as >^o^jj^wfftnd Jike?* ' - • 



Ability to Attend 
Sufficient ^ngfish 
In-SerVice Session^ 



Yes 





^ No 



Elementary'^^ Secondary 



% 41 



66 



38.3 



38 



28 



57.6 



42^4 



Total 



79 



94 



45.6 



k54.4 



4 

t.' . 
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• INSTRUCTIONAL ACTIVITIES AND ATTITUDES 



1 



ji^ Availability of Teaching Aids • , 

Teachers* ratings of the availability of 14 different reaching 
aids are given in Table 17, separately for elementary and secondary ^pvels . 
The teaching aids are listed in this table .in the approximate order in 
which they were rAed by all teachers as adequate. 

Elementary and i^jpSndary teacheri availability ratings '^due^ ^irly 
similar vjith respect ia all but five of the teaching aids 'listed.* A sub- 
. / stantially larger percentage of elementary than secondary teachers rate 
the availability of professional journals, tex,tbookr, supplementary rea^J- . 
ing materials, newspapers and ETV a^inadequate . 



TABLE 17 , Percent of Teachers Giving Each of Three Availability Ratings 
(Inadequate, Barely Adequate, Adequate) ,tt> 14 Different Teach- 
ing Aids, Separately for plementary and Secondary Levels. ' 
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* ' * 

T^pe of Teaching Aid 


Availability ^ 


Inadeq 


uate 


Barely Adequate 


* ' Adequate 


Elemen- 
tc^ry 


Secor- 
dary 


^lemeiT- 
'^tary 


Secon- • 
dary 


Elemen- 
tary 


Secon- 
dary 


Access to Principal * 
or Vice-Principal 


V 

1.8 ^ 


5.6 


6.3 


12.5 ■ 


91.9 


81.9 


Audio-Visual 


5.1 


1.4 


■ 8.5 


10. t . 


86.4- 


87. 8^ 


'Access to 
Department Flead 


33.3 


2. 9 


: 20.0 


0. 0 


46. 7 


97^1 


Library or 
Resource Center 


2.. 5 


6.8 


13.6 


13\ 5 

J 


83.9 


'?9. 7" - 


L.M.C. - ^ 


16.6 


10. 9 


15.5 


7.8 


70'. 9 


81.3 


Professional Journals 


17. 1 


9.1 


25.7 


To. 6 


57.1 . 


80.3 


Textbooks 


■$).s 


2. 7 




16.2 


50.4 


81.1 


Access to 

Consultant - «b 


20.7 


22.1 


15.9 


16. 2 




61.8 


Access to Int6-rest/* 
Study# Groups 


2-8.4 


' 11.3 


26.5 ' 


IP. 7 


. 44.8 


71. 0 


Ministry Curriculum . 
Guidelines 


24.0 


20.4 


24.0 


'20.4 - 


52.0 ♦ 


59. 3 


■ ■ . ■ ■ ■ — — y 

E.T..V. ' ' 


34.6 


16. '4 


17.3 


11. 9 


48. 1 


71.6 


• 

Newspaper * • 


37.5 


i^i 


17.3 


13.6 ' 


4>. 2 


' 74. 2 
1 


Supplementary 

Re adi ng ^ate r i a-l s 




. 18. .9 


19.1 1 


18. 9. 


4-1^7 


.62. 2 


. Access to - 
Steering Committqds 


31.7 


'21.3 


32.7 ^ 


21.3 


34.6 


57.4 
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Jrcupim, Insuruati-^-nal Techniques and Pro§rar^ Emphasis 

Teachers were asked to estimate the percentage of the time they 
divide their English classes into'^abi lity or achievement subgroups for 
instruction. Their responses, summarized in Table 18, indicate that group- 
ing 'for instruction is done by a majority (75%) of teachers for 25% or less 
of the time. Grouping is apparently a somewhat more frequent practice at 
the elementary level , perhaps in' part because at lea^t some high school 
classes are already partially *groupe'd' by students' choice of level four 
Or Ije^el five programs. " . 



TABLE 18 

9 




Teachers* Estimates of the Percentage of Time They Oivi 
[Their Classes Into Subgroups for Instruction. 



% of TimeSQasses 
Divided Into Groups 
For Instruction 


Elementary' 


Secondary 


Total . 


- N 


% 


N 


• % 


N 


% 


a-- 10 


45 


3'J.| 


38 


52.1 


83* 


44.6 


11 - 25 


34 


3(J^1 


23 


31.5 


57 


50.6 


• 26 ■- 50 


18 




8 


11.0 

• 


26 


14.0 


51 - -h 


10 


!;.8' 




1.4 ' 


11 


5.9 


>75 , 


6 


'\ .3 


3 


4. 1 


9 


4.8 
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teachers* estimates of th^ frequency with which they use 12 
different instructional techniques ar^ summarized in Table 19a. The^, . 
techniques are listed according to their approximate frequency of use by 
all teachers, e.gt, questioning is the most frequently, and field trip's 
the least frequently used technique. Table 19b gives a distribution of 
the number of different techniques teachers reported using frequently. 
It is apparent from the d\ta 6i these two tables that teachers use a wide 
variety of instruct i&naLnnethods at both elementary and secondary levels,, 



with considerable re 



ice on questioning afid cl^ss discussion. 



TatbJe 20 gives the average percent of time^ teachers estimated *they 
devote to five majqr components of the Intermediate English curriculum. 
Both elementary and secondary teachers spend appro^cimately the s-ame fi^me 
on composition (18%) and vocabulary (7%). Secondary teachers ?pend ^ * 
relatively more time on literature and elementary teachers relativel'y more 
time on grammar and spelling. ^ 

-Teachers were asked tO' evaluate the personal difficulty they 
encouniier in.teachi-ng each of the five areas considered 'in Table 2t) by/ 
rank ordering them.' The percentages of teachers gjving each rank to each 
area are given in Table 2l. It is apparent from these data that: secondary 
teiachers are most\comfortable teaching literature and much more so than'^are 
elementary teachers; secondary teachers find teaching grammar and spelling 
the most difficult, wherreas eTementary teachers aYe moderately comforta^Je^ 
teaching these two areas: elementai%^ teachers rate grammar as the least 



r 
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difficult sub^tjct to teach and apparently have considerably less trouble' 
with It than Secondary teachers; both groups put vocabulary in the 
intermediate range of difficulty. A comparison of the data in Tables 20 
and 21 suggests that teachers may devote slightly less time to those areas 
which they find most difficult to teach. 



TABLE 19a 



Teachers' Estimates of the F^^quency With Which They Use 
Various In^structional Techniques. 



- 

Instructional 
Technique 


Extent of Use 


Never 


Occasional ly 


Frequently 


Elemen- 
tary 


Sec9n- 
dary 


Elemen- 
tary 


Secon- 
dary 


E lemen- 
tary 


Secon- 
dary 


Lecture * 


23,7 


26.8 


67.5 


70.4 


8.8 


' 2.8 


Questioning 


0.8 


< 

1.4 


12.4 


8.1 


86. g 


90.5 


Class Discussion 


, 0.0 


1.4 


16.7 


20.5 


83.3 


78.1 


Dramati zat ion 


16.0 


5.4 


74.8 


85.1 


9.2 


9.5 


Small Group Discussion 


4.3 


5.5 


72.6 


72.6 , 


23. 1 


21.9 


Field Trip 
^sr^ ; 


46.6 


54.8 


50.9 


45.2 


.•2.6 


, 0.0 


Seminar 


59.8 


27.4 


36.4 


60. 3 


3,7 • 


12.3 


Film - 


10.8 


9.5 


77.5 


'81.1 


11.7 


• 9.5 


Reading Lab 


28.3 ' 


45. 7 


50.4 • 


22.9 


21.2 


f 

31.4 


E.TtV^ 


41.6 


24. 7 


54.0 


67. 1 


4.4 


8.2 


Independent Study 


6.8 ,< 


31.9 


■ 70.1 


"54.2 


23.1 


23. 5 


Instructional Game 


28.8 


29.0 


63.1 


. 58.0 


1 

8.1 


13.0 



TABLE 19b 



.Number of Different Instructional Techniques Used 
Ircquently. 



ERIC 



Number of 
Different Techniques 
Used Trequently 


Elementary 


Secondary^ 


r ^ ^ 

Total 


N 


% 


N • 


% 


N 


% 


n, 1 . 




io.8 


13 


17.6 


26 


13. 3 




41 


34.2 


i' 

23 . 


31,1- 


65 


33.2 ■ 




39 ^ 


32.5- 


20 


27,0. 




30.1 


4 


- 16 


13. 3 


9 


12.2 


25 . 


12.8 


> 


11 


■ -9. 1 


•9 


i2.2 , 


21 


10.7' 


Axcrage ^ *' 


2, 


82 ' 


2. 


77 




81 . 


* 






:) ■ 


*• 


S 

i 

a 
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.TABLE 20 Meaii Percent of Estimated Class Time Devoted 
to Five Major Components of the Curriculum. 

I 



Mean % of Class 
Time Devoted to. . . . 


1 

% 

E l^mentary 


Secondar)' 


Total 


Literature 


37 . 95 


57.48 


45.65 


Composition 


19.23 


17.97 


18.72 


Grammar 


1^.57 


• 12.34 


16.06 


Spel 1 ing 


IS . 86 


5. 10 


* 11.59 


Vocabulary 


( .48 


7.72 


7.00 



r — X: 



TABLE 21 Percentages of Tefachers Giving Each Rank OiKler of 'Diificulty 
in Teaching* to Five Subject. Areas , Separately for Elementary 
and Secondary Levels. 



1 * ■ 1 

> 

* 

Subject- 
Area 


Rank Order of Difficulty in Teaching 


1 

Most 
Difficult . 


2 


3 


4 


5 

Least 
Difficult 


c 

o 

B X 

o u 


Secon- 
dary 


t 

s t 

^ ^ 


Secon- 
dary 


Elemen- 
tary 


Secon- 
dary 


1 

tary 


Secon- 
dary 


Elemen- 
tary 


Secon- 
dary 


Composition 


43.6 


19, 0 


21. "8 


r r 

27.il 


17.3 


14. Z 


10.0 


zz. z 


7.3 


6. Z 


Grammai; 


18.7 


40, 6 


15.9 


17. 


16.8 


29. 7 


23.4 


10. 9 


25.2 


1.^6 ' 


Literature 


14.0 


4, 3 


30.8 


4.'> 


21.5 


8'. 1 


17.8 


16.-1 


15.9 


66. 1 


Spelling 


12.5 


34, 6 


,21.2 


22.- 


'16.3 


17.2 


30.8 


'IZ. 8 


19.2 


12.1 


Vocabulary 


15.2 


34.5 


17.4 


SI. .'■ 


33.7 


28. 1 


16.3 


25. 0 


'17.4 


6. Z 



Assignments and Requirements 

' i - 

Teachers were asked to estimatg^ the frequency wrth which they give 
seven different kinds of assigrnnewts to x^t^ classes., Their responses 
are summarized in Table 22, which the assignments are listed from mo^t 
to least frequently gi.ven by all teachers. \There are some similarities . 
and differences between elem^rit^ry and secondary teachers in the frequency 
with^ which they give various assignments. For example, elementary teachers 
require their students both to w^ite a creative composition and Memorize 
poetry more frequently thanv secondary teache^rs do. , 
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Teachers' responses to the request to estimate the frequency with 
which they maKe six different requirements of students in their English 
classes are summarized in Table 2S. 'The requirements are listed in Table 
23 from most frequently required to least frequently required by all 
teachers. As in the case of assignments, ther^ are differences in the 
pattern of requirements bet\^een elementary and secondary levels. For 
example, elementary teachers are more likely to require students to recite 
poetr>- and give a speech to the class than are secondary teachers. 



Teachers* responses to ques ions related to four facets Df their 
attituces or opinions toward Englisli are summarized in Tables 24a, b, c 
and d. 

The data of Table 24a indicate that the majority of teaciers feel 
that English is regarded as at leasi or more important than other subjects 
in their schools. Elementary teacht-rs are much more inclined to feel that 
English has special importance in tlteir schools than are secondary tpachers. 

Teachers* ratings of th^ relevance of the content of the English 
prograir to the current needs and inierests of- students are summarized in 
Table 24b. Most teachers feel English is of average. or high relevance, 
with secondary teachers more positi\e in their evaluation than eTementary 
teachers . 

Teachers* responses to a question about theij enjoyment m teaching 
English are summarized in Table 24c/ The great majority of all :eachers 
(94%) like to teach EngHsh as well-or*better than other subject;. Secon- 
dary teachers, however, are much mcrte enthusiastic than elementary teachers; 
85% of secohdaw teachers indicated that they *enjoy teaching En.;lish and 
wduld "rither teach it than any othei subject* whereas .only 18% o: elemen- . 
tarry teichers checked t"his altemat3Ve. 

» Teachers/ /^onf idenc^ in fheir ability to teach English wis estimated 
by their responses, summarized in Tcble 24a, *to a siiigle, multip .e' choice 
item.^rhe ^ea^, majority (87%) of cll teachers feel they are as capable, pr 
more capable of teaching Lnglish as they are any other subject. A signifi- 
cant minority (13%) don,*t feel they have been adequately prepared. Secondary 
teachers are; considerably, more confident tK-an elementary teachers. 

* • * * 

Teachers *' responses to the four it'titude items reported in Table 24 
were intetcorrelated. .The only substantial correlation (.53) was between 
teachers' enjoyment of teactang English 'and their confidence - in their ability 
tcr teach it. It appears that, in'geperal, teachers who have spec;i'al i zed in 
English are more confident Ihd enjoy teaching English more th^n teachers who 
are not English specialists. • - ' / 
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TABLE 24 Teacher Attitudes and Opinions About English 



TABI.l 24(a) 


Treatment of English 
in Your School 


Elementary 


Secondary 


Total 


N 


'b 


N 


% 


N 




^...always treated as most important 


16 


13.3 


3 


4.3 


19 


9.9 


...most often treated as most important 


58 


°48.3 


15 


21.4 


75 


39. 1 


...treated lust like any other subject 


. 35 


29.2 




45.7 


67 


34.9 


. . . occasional^ly treated as most important 


8 


6.7 


'-14 


20.0 


22 


11.5 ■ 


...rarely treated as most important 


3 


2.5 


6 


8.6 


^ 9 


4. 7 




< 


/ * ^ 

Relevance Of Content of English Program' 
to Current Interests and Needs of Students 


' High . 


Average 


Low'^' 


o ^ 
— t C3 


Secon- 
dary 


c 

o 

.£.->v . , 

—t a 


1 

rr 

. 5 f.- 

o. ^ 


1 

E >. 
^ c« , 


1 

0 >s 

O CO i 

^ CO -o 


18.6 


35.2 


•73.7 


63<T^s 


,7.. 6 


i.4 


' » 


TABLH 24(c) 


» 

Feeling About Teaching English 


Elementary 


Secondary 


Total ' 


N 


q, 

"0 


N 


% 


N 


a 


' ' ' ' g ; ^ ■ ^ — 

...rather teach almost anything else 


9 


7.6 


2 


2.7 


12 

-Am 


6.2J 


...like to teach English as ^ell as anything else 


«9 


74. 8 


9 


12.2 


98 


.so.'s 


...enjoy and rather teach it than anything else 


21 


17.6 




85.1 


84 


43.3 


i f '* 

1 » 


TABLl. 24(d) 


# Confidence in Ability To - 
Teach English 


Elementary 


Secondary 


Tot a} 


N 




N 


% 


.N 


a 


... haven *t been; adequately^ prepared . . , 


21 


17.6 


4' 


5.5 


25 


13.0. 


...as good as in an^ other subject ^ 


sx 


r 

42.-9 


V 

: 6 


' fi.2 


Si 


29.5 


...qui^e confident - 


47 


39.5 


63 


86.3 


111 
' — ^ — 1 


57.'5 
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Teachers were asked to rate the degree to which there t'S'^a useful 
exchange of ideas about the Cnglish program within and between schools in 
their 'family*. Their responses are shown in Table 25. 

Although a majority of both elementarv' {67%) arid secondary (95%) 
teachers indicate that there is an 'adequate* or 'good' exchange of ideas 
about the English program aincng teachers in their . school , a third of 
elementary teachers rate the exchange as 'unsatn'sfactory ' . .The majority 
of teachers (80-85%) feel that the exchange^of ideas among-elemefrtary 
schools in their family and between the secondary school and its' feeder 
elementary schools is 'unsatisfactory*'. 

TABLE 25 The Percent of Teachers' Giving Each-of Three Ratings of the Degree' to 
'Which There is a Useful Exchange of Ideas .About the English Program 
Within and Between Schools. 



Degree to Which a Useful Exchange 
^ of Ideas About -the Ertglish Program.... 


Good 


Adequate 


s Unsat- 
isfactory 


£ X 


1 


r 

— < 


Seconr 
dary 


4 

r- 

:i 


Simeon - 


...among teachers un your* school 


■ 24 . 8 


66,2 


41.9 


27,0 


33.3 
•> 


6.8 


•...among elementary schools in your family 


2.7 


0, 0 


18.9 




12,1 


78.4 


^7. 9 


.between .secondary school and its feeder 
, efefrentary schools in your family 


1 

0.9 


4,3' 


12.8 


21.6 
- - 


r- 

,86.2 




84. 1 

<• 




eTREUGTHS AilL WEAKJIESSJES 



In t+iis free- response part #f the survey teachers were -«sked to 
describe the major strength::' antfSv'ealcness^^s of the courS'e they were' 
j)resently teaching in Intermediate English. Tn order to summarize these' 
"srfata don,ter)t, categories were developed from a readj.ng of all teacher^' 
^ re^^ons^s^ ^d -then each strength or weakness listed by teachers was " ' 
^ 1 assigned 0»e of the categories. The number and percent of times* each 
t>T)e of str^'ngth-^ or weakness was ^iven are shown, separately k*or elemental;/ 
amd secondary teachers, in Tables 26' and 27. The content categories for 
" '^strengths and weaknesses , aloft^with paraphrased examples of the. kinds 'of . 
''^ ^jresponses gtLven^by teachers are given in Appendix A. It 'is fairly pbviou^^t 
from these data; that there is considerable variabilit'y in teachers' evai.u- 
ation^ of the strengths anck weaknesses of fhe Intermediate English program. 
^ ' ''Whereas some teachers >ee the man/ ^d varied resources avai lable to them 
^ as a strength' of the program, a substantial number, ^ee inadequate resources 
, • ^4s a major weakJiess. * • i'*'- . - 
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TABLh 26 Number and Percent of Times Teachers Gave Each of 
Five Different Types of Strength of the English 
Program. 



Area Of 
Strength 


iUementary 


Secondary 


Total 


N 


% 


N 


% 


N 


% 


Definit ion 


1 


,1.7- 


2 


3.2 


3 


2 

2.4 


Organization 


13 


*22.0 


14 


21.9 


27 


22.0 


Resources 


20 


33.9 


13 


20.3 


33 


26.8 


Emphasi s 


23 


29.0 


• 34 . 


53.1 


57 


46. 3 


Nfethods 


2 


3. '4 


1 


l.,6 


3 


2A 



lABLE 27 Number and Percent of Times Teachers Gave Each of 
Five Different Typ ?s of Weakness of the English 
Program 



Area Of 
Weakness 


Elementary 


Secondary 


Total 


N 


% 




% 


N 


% 


Definit ion 


10 


8.3 




7.5 


15 


8.0 


Organi zati on 


22 


18.3 


18 


26.9 


40 


21.4 


Resources 


62 


51.7 


20 




82 


43.9 


Emphas i s 


17 


14.2 


19 


28.4 


36 . 


19.3 


Methods 


9 


7.5 


5 


• 7.5 


14" 


7.5 



A* quest ionnai re 
teache:*s in grades 7 to 
returned by 58% of them 




insisting Df 30 items'was'distributed to all 
nclusive who currently teach English an^ 



The results, presented primarily in. tabular form, were considered 
in terms of the following areas; teacher jcharatfteristics , situations and 
professional activities; instructional activit^^ and attitudes; assign- 
ments given Jto, aijd requirements made of students; teacher attitudes; 
exchange of ideas among teachers 'and schools, and strengths knd weaknesses 
of the English program. 

' ' ' •• ■ ' , S \ 

: There are fairly marked differences between the situations^ train- 
ing and attitudes of elementary and secondary English teachers. Teachers 
exhibit a substantial degree of consensus, on certain issues and are some- 
what divided on cithers. The attitudes and opinions expressed by the 
teachers have sojne; fairly direct implicatfons for improvements in the 
English curriculum. ^ ' , ^ ' # 



MAJGb i;imiNG3 

A review of the data displayed in the 27 tables Of this report 
reveals the following major findings: 

. 1. The majority of intermediate English teachers have had most ' 

of- their experience at the grade level at which they are currently teach- 
ing. This fact implies that it may be diJ'ficult for them to develop an 
'/adequate conception of where and how their contribution fits into the 
entire K-13 English curriculum. This problem may be especially acute 
across the elementary to secoridary transition. 

2. The faculty involved in teaching-^intermediate English is .both 
weU' qualified and experienced. 

3. Unlike the situtation m secondary schools, fully three- 

t quarters of elementary teachers of English do not perceive themselves as 
specialists in this subject. This fact has. a number of important implica- 
tions requiring furtheip investigation. Among others, it raises the issue 
as to whether special measures are required to encourage elementary 
teachers to specialize in English, with the ultimate goal of ensuring at 
least one English 'specialist* in each elementary ^school . 

4. The nature of teachers' assignments in the elementary p^el 
makes it difficult to, provide concentrated attention on English. This 
problem iMmuch less acute in most other subject areas, e.g., music, 
French.^ -The implication of current staffing practice is that there is 

no need-for specialized training oSl; elementary faculty who teach English. 

5. A significant number of "Elementary administrators teach 

English. 

6. Teacher participation ir English-oriented pt^ofessional organ^ 
• izations is alarmingly meagre. This suggests a definite need to develop 

special incentives to increase .participation ^and professional , growth . 

7. The majority of faculty te,aching i^ntermediate English feels . 
need for more inservice training in this subject than it is currently . 
receiving. This need is feltr most acutely in the elementary panel. 

'8. Generally, speakings the human and material resources necessary 
to support the English TJrogi^am are least adequate in the elementary panel. 
The major needs seem , to be: (a) texts and supplies at the elementary 
level (b) access to study, interest and steering groups in* both elementary 
and se'cond^ry panels, and^c) professional journals and reading material 
at thO' elementary level. 

• ^ 

' • 9. "Teacher- centred" methods are^ the most frequently used instruc 
tiona^ techniques. Students receive the great majority of their instruc- 
tion in class-level groups, especially at tKe secondary level. 



10. There is a_ significant shift in the amount of instructional 
time devoted to ^'skiils'"^ versus ^'literature** as one goes from the elemen- 
tary to the secondary panel.. This shift in emphasis seems to be related 
to the differing degrees of confidence elementary and secondary teachers 
have in their ability to teach these areas. 

11. In tertns of the broad areas of instruction included in the*' 
English program (Reading, Writing, Speaking and Listeriing), there is a 
serious over-emphasis on student assigBiments. involving writing. 

12. Secondary teachers of Eiiflish both eajoy teaching English 
more ^ and are more confident of their ability to do it'than are elementary 
teachers of English. This motivational difference has significant impli- 
cations for any proposed improvements in the teaching of English. 




13. - It is quite apparent that elementary -teachers experience 



considerably more (difficulty in conununi eating effectively about the 
English program within their schools than do secondary teachers* It is - 
also apparent communication amqng elementary schools in the same * family^* 
and between secondary schools and their 'feeder' schools is largely un- 
satisfactory. 

14. There are apparently some significant perceived inequities 
*in the distribution of resources both between elemehtary and secondary 
panels and also among elementary schools. 



- 23 



ERLC 



INTERMEDIATE ENGLISH EVALUATION PROJECT PUBLICATIONS, ^ 



Dickie, L. background and Flan for the Intemediate English Evaluation 
Prc^'ect. Board of Hducation, London, Ontario, 1974 (mimeo). 

Dickie,^ L. & Rice, E. T.'- Intermediate English Evaluation Proje?t: Stating 
the Objectives^ Board of Education, London, Ontario, 1973 (mimeo). 

Stennett, R. G. , Dickie, L. , Rice, E. T., Clift, G. § Waite, N. 

Intemediate Enjlish Evaluation Project: Student Attitudes, . \ 
Board of Education, London, Ontario, 1973 (mimeo). 

Stennett, R. G. -o I'^^cs, Loma, Inteimediate English EVQluati^n. Project:' 
cUr^J^u Teachers^ Board of Education, London, Ontario, 1974 
(mimeo). ^ 

Males, S., Dickie, L. , Rice, E. 5 Stennett, R. G. Intermediate English 
Evaluation. Project : Community Attitudes, Board of Education, 
^ London, Ontario, 1975 (mimeo) 1 

V • • 

Stennett, R. G. 5 Isaacs, Lorna. Intermediate English Evaluation Project: 
Survey^ cf Student Achiepement - Overview, Board of Education, 
London, Ontario, 1974 (mimeo). 

Stennett, 'R. G. 5 Isaacs, Loma. Intermediate English Evaluation Project: 
Feading - Student Attitudes and Achievement, . Board of :itlucation, 
London, Ontario, 1974 (mimoo) . 

.Stennett, R. G, ^ Isaacs, Loma. intermediate English Evaluatitm ^ Project: 
Writing - Student Attituder and Achievement,^ Board of j-ducation, 
London, Ontario, 1974 (mimoo). ' "^xi 

Stennett, R. G. & Isaacs, Loma. .intermediate English Evaluatiim Project: 
^ Listening, Board of Education, London, Ontario, 1974 (iiime\). 

Stennett, R. G. S Isaacs, Lorna. jntemediate English Evaluation Project: 
Speaking, Boa^ o£ Education, London, Ontario, 1974 (m meo) . 

Stennett, R. G. & Isaacs, Lorna. jntermediate English Evaluation Project: ' 
Verbal Creativity, Board of Education, London,. Ontario, 1974 
(mfmeo) . . . ^ . . ' " 

Stennett; R. G. 5 Isaacs, Lorna. Intermediate English Evaluation Project: 

Attltud'-^s Revisited, Board of Bucatlon , London, Ontario, 1974, 
^' (mimeoj. 

Lftimer, R. D. n?: ^vcrvz^'^v of the English lay^jAageJirts n^grans - 

Intermediate livisicn, C^ity^ of London Schools^ Ministry of Educa- 
tion, Ontario, 19^3 (mimeo) . 




INTERMEDIATE ENGLISH tVALUAT ION PROOECT: COMMUNITY ATTITUDES 



Males, L. Dickie, E. Rice S R. 

Board of Education 
Lbndon, Ontario 



G. Stennett 



V 



Educational Research. Services 
\ " ^ Research Report 74-06 , • 

aL paft*oSf the overall evaluation plan (Dicijie, 1972) to reach 
.beyond thie educational system, the English Program planning Coranittee 
decided conduct a series of structured interviewl _ in th'^' London 
couununit)^. Although limitations oi time and resources ^precluded the 
possibility of a thorough-going, rigorous, representative sampling, the 
Committee felt that the opinions of at least three major groups should 
be solLtited; namely, parents of sqhool-aged children, employers of 
graduates of the London system and citizens who were neither employers 
nor h^ children ^enrolled in the School system. The Coimrfttee recognized 
the mAny limitations of such a survey, but hoped that it would, at the 
very /least, provide some possible insights into community attitudes and 
inti-cate' which areas of public concern might toerit additional study. 

/ • ■ • 

'j ' ^ ' . mTWD , ' 

/Sample Selection ' ^ 

The people to be interviewed were located through the Personnel 
Offices of^ocal businesses , ^ndustties and public institutions. Early 
in February, 1973, in response to a letter from the Director of Education, 
17 of 18 such institutions contacted agreed to help wi|;h the project. 

A list of the 17 institutions jparticipating, grouped by ty^er, is^ 
present,ed in Appendix A. Each firm, contacted had a wide variety of -position 
descriptions. However, most employers responded in terms of clerical- type 
positions. Two employers hire primarily in the sales field and two others 
in the technical-production fields. 

' Using this source of subjects, as well as 'man-on- the-street* 
interviews in shopping malls, plazas and other locations, a total of 91 
interviews were completed. Of . this total, 17 were with employers, 21 with 
parents and 53 with 'citizens', i.e., person* who were neither employers 
'nor parents of school-aged children. 



Interview Procedftre 

All subjects were. interviewed by a univeis 
'some experience in dealing wit^h various segments o 
interviewer, paid for his work from a winter; ,work[s 
structured interview form far each of the three 
(The questions asked are quoted verbatim in the 



ity graduate who had had 
of the population. The 
grant, used a different 
categories of respondents, 
suits ' section. ) The 



re 



/ 
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employer and parent interviews each consiste'd of 11 questions and the 
citizen survey, questions. 

The interviewer attempted to conduct all interviews in as standard- 
ized and structured a fashion as possible. Each person >was asked to respond 
to all the questions on the schedule designed for persons in his categdry. 

^ However, not all respondents could answer allr questions and some 
qiJstions were modified or added to the various sch/dules in light of 
experience gained in the early interviews. Becau^ of this, the number 
oF' respondents varies slightly ^from question -to cfuestion. 

* The emphasis in the three interview s)ihedules varies:" the employer 
survey was concerned primarily with the releva^lce of English skills for 
employroent and employers' assessment of applicants* skills in English; the 
parent schedule involved questions' about parents* attitudes toward, and 
awaropess of, their children's English pxogram; , the citizen survey covered 
a variety o\ topics ranging from attitudes to English to readijig and TV 
viewing habits. / > 



Timing of Interviews 

All interviews were completed during Fe(^ruary and , March of 1973. 



Data Handling and Presentation 



Subjects* responses to all questions were tabulated by hand, 
separately for each of the three groups. In cases in which no clsassifi- 
cation of responses was _ determined by the question, a classification was 
developed from, the subjects* responses^and the number of respondent^ 
giving a response in each category counted. 

In some instances, because different numbers of subjects answered 
certain questions, the numbers have been" converted to 'percentages of 
respondents * . 

In the interests of brevity, the results will be presented as ' 
follows: the interview question will be given (in italics); a simple 
tally of subjects* responses presented and, where appropriate, brief 
comments or interpretations., ^ 4 * 



RESULTS 

^ l\ EMPLOYER SyRVEY 

Q.l(a) Do you require a certain degree of language *proficier^y as a, 
qualification for employment? . * 




Of the 15 respondents who answered 'Yes' to this question, 4 
specified certain' educational levels on the assumption tfiat language- 
skills would correspond to that level, e.g., grade 12 for clerical help, 
grade 10 for postal workers. 

The two respondents who 'had no language proficiency requirement - 
were in the technical-production fields, in which manual dexterity was, 
considered more important than the ability to use English well. 

Q, 1 (b) What proportion of prospective employees have a high degree of 
English proficiency? - , . 

Eleven employees responded with 'Very few', three sai5 'Most' and 
three did not feel they could make a judgement. - . 

Although it is obvious that employer expectations" varied in terms 
of their judgements about the meaning of 'high degreeof proficiency ' , it^ 
is evident that employers woi^ld classify few prospectfTVe employees as 
highly proficient in the English language. (Employers noted specific 
deficiencies in" response to Q.6.) ^ ^ 

Q.l(c) Are prospective employees sometimes rejected becaus,e of an inability 
to spetl correctly c^jaxpress themselves well on an application 
form? " / 

In response to this question, nine employers responded 'No' , three 
said 'Yes' and four said 'Partly'. ' 

The largest number of respondents indicated that,' wfdle basic abil- 
ity in the language was- important , otte^r elements in a person's presentation 
(e.g., personality, school record, ^ enthusiasm and confidefide^) we2?# more 
important than impeccable^ use 6i the English language. 

Six employers were asked to estimate the percentage of job appli- 
cants who have problems in English profi<iiency on either application forms 
' or stan(^ardized tests. Their estimates vfere as follows: 25., 25^ 30, 40 
40 and 90%.' A seventh employer estimated that 25% of his present employees 
could not spell correctly and that 50% of those whose work required the 
writing -of reports were unable ta do so in proper fashion. 

Although employers apparently feel that the majority of applicant/ 
can manage application forms and standaitiized tests, they do see a signifi- 
cant problem in English proficiency among prospective en?)loyees. / 

7 • 

Q.2(a) Do you administer some type of standardized test to prospective 
employees? . 
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Eight of the 17 employers a<linii}istered .such tests. In 7 of the 8 , 
-cases, 'the tests contained an 'English proficiency' section, limited pri- • 
marily to spelling and/or vo.cabulary. Although only 1 of the 8 actually , 
used a specific English proficiency nest^ 2 others sometimes used pro- 
ficiency on application forms as a screening device. 

Q.2(b)^"Hou well do appliaante perform on the English proficiency eeotions? 

Four of the eight employers reported that applicants generally 
gave 'unsatisfactory performances on English proficiency sections. 

Three employers reported a marked superiority in English proficiency , 
as characteristic of applicants with post-secondary-schoo,l training. - Two of 
these emp loYeTs "seemed to recognize the likelihood that this phenomenon . 
merely reflects the generally greater intellectual abili.ty of applicants 
with such training. • 

- \i « 

S mat- language skills do you regard qs prvvary requirements 
. empVoyment in your fix^? 

Of 12 employers for whom language skill is an important requirement, 
8 specified writing skills and 4, oral skdlls. 

The comments of 5 employers about, the language skills of their more 
recent employees are reproduced below: 

'Most young people have difficulty writing a grammatically correct 

letter.' 

' " ''Some of the letters are unbelievable.' 

'Written reports for circulation are frightening; they (the 
authors) do not see what is ^rong or why.' 

'Probably not more than one or two out of a staff of six or sevens, 
secretaries. coul.d sit down and write a good business letter. They have 
no sense for sentence structure and paragraphing.' 

• 'People now tend to structure letters tbe way they talk; - therefore, 
they include some slang pr inappropria^e^language. 

Oral coipmunication is probably improved, perhaps because we accept 
looser standards here". ^ ^ • v 

Misspelling of simple words is bothersome and costly The! average^ 
cost of producing a typed business letter is $3.50 to $S.5<fr Each letter 
rejected due to errors costs this amount. Every third letter/ received by 
the firm has errors^ in it.' ^/ 
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I8 the izbility to analyze and interpret printed material on the 
'job important?- , 



such s 



/ Nine employers responded 'Very Important' and e^ight indi 
skills to be; 'Somewhat Iij|^ortant' . 



cated 



Although not rated as primary, all respondents indicated that 
these skills were important to a greater or lesser degree. Even the two 
employers who did nof require English proficifency indicated that production 
workers and mechancis must be. able to read about new products, machines, 
mechanical innovations, etc. 

One employer indicated that employees can^derstand memos, but 
cannot write them or spell correctly when preparing them. 

/ 



Q. 5 



How important is oral aormuniaation? 



" Thirteen employer's responded 'Very Important' and four 'Somewhat 
Important'. Oral yomhunication skill is apparently important in varying 
degrees in- air firms surveyed. ' ' 

F6W employers indicated problems in the area of oral communication. ^ 
As one 'employer pointed out, oral communication can occur even wlrfen pro- 
ficiency is low; an illiterate can communicate^reasonably well orall>^/ 
despite deficiencies in grammaiwor pronunciation. Of coursesome positions, 
particularly involving commilinication outside the firm, requV^X irtuch higher 
levels of proficiency'., ^ ^ ^ 

Q. 6^ ^ do you feil abquj^ ^the' language skills of current high school ^ 

graduates? ^ ' * . 

Employers^ re«ponse6 to this question are summarized in Ta^le 1. 
Two employers indicated 'no problems' and pne said-he avoided hiring high 
school graduates. 

. This questioawas the open-ended type 30 that areas of pVimary 
concern to employers would- 'be more likely to become evi-dent. The f^ct^ 
that many -employers ^swered this question at the beginning of the inter- 
view-Before being asked, coupled with their responses as detailed in Table^ 
r, indicates that, as a group, they are very dissatisf iTed with the language 
skills of current graduates. . ' 

In order to' give 3ome indication of th.e feelings of eifiployers on ^ 
this issue their- coppents *and suggestidns for improvement are outlined 
' below. » ' . 
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TABLE 1 Nqmlier of employers who rated each of seven 
different -languagC^skills as either 'good' 



or 'pbor ^ . 



• 

Skill** 


Employer Rating* 


Good 


Poor 


Dictionary Use 




. 3 


Grammar, Style, Structure* 


1 


9 ■ 


* 

Oral Communication 


2 


3 


Punctuation 




- 2 


Reading 


1 




Spelling 




10 


Vocabulary 


1 


3- 



^Employers.' evaluations, given in different language, 
were reduced/to these two simple categories. 

^Since employers' responses came from an open-ended 
question only those skills they mentioned are list- 
ed. Also^ for the same reason, not evefy employer 
commented on eacl)-skiil. 



Employers Comments Re , 

\ : ' \ 

(i) Dictionary Skills, - 'They do not consult the dictionary.' 
'They guess at words or make words the/ are too laiy to »use a 

^ dictionary.' 'Therfe is an 'attitude ^of la-ziness in dictionary usage.' 

»^'/ / • ' . 

\ (ii) Graimar oM Vocabulary Skills. 'Vocabulary is very limited; , 
* there is a need for more>stress. on grammar.' 'Grammar is as good as 
^ speech and speech patterns are reasonably good.' 'A male 6 § C,^ graduate 
has limited vocabulas^y and ineffective style in verbal and written communi- 
cation. Female 8 C graduate seem quite good in vocabulary, but also 
laak in style* FivVyear students are noticeajjly better than four-year 
stud^ts in the 4rea of . vocabulary ^nd style.' 'Lack-of punctuation is a 
real problem.' 'Many have grammar problems.' 

4 

(iiv) Spelling. 'Misspelling is incredible.' 'Spelling is dread- 
ful?' 'Spelling is the major -difficulty. ' 'Simple words are often mis- 
. spelled,., ' >Vs years go by, graduates get worse.. Anyone graduating in the 
last fen years cannbt spell.'' ' Spelling-and listening are poor.' 



^Business and Commerce program, as defined in Revised Plan, 1961, Depart- 
-merit of Education, Ontario. 
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^(iv) Other. 'There is a lack of proper education ia basic English,' 
'The^fe is a general upward trend in proficiency.' 

Employers' Suggestions for Improvement (Q,6) 

'Students need more, training in sentence structure, 'grammar, 
spelling, etc., than in Shakespeare and literature. The early stages of 
high school are not helpful.' »• . - , 

t 

'We would like to see an emphasis on love for the language rather 
than on 'English as a drilled discipline. There is a need for a greater 
emphasis on reading.' 

'The school system should provide a post-school course in basic 
English. (One employer asked if there is some kind of night course in 
remedial English to which his firm could send problem cases.) The schools 
should look to the community college for a model in relating education to 
industry. ' 

'There should be some limits on freedom of course selection because 
,a student might avoid things that he really will need in life. Grammar and 
spelling ought to be taught just as much as is litei^ature, i.e., in addition 
to literature. * 

' 'Being able ta read Shakespeare and appretiate it is great, but 
then the student should be able to write an essay on it and- spell correctly.' 

'Get back to the three Rs. ' . ^ * 

'The ^*enriehment" philosophy of education is not good for everyone. 
Education shpuld be as strict as it once was.' 

Q. 7 What do you consider ^o be the main strengths of current graduates? 

v V 

This question, asked only in later interviews, was ^swered by 
seven employers. Three employers indicated that recent graduates are more 
communicative and not as backward or shy as was foymerly the case. One 
mejiijoned improved vocabulary, but inappropriate usage. *^ 

Q, 8 Is there any difference between the type of person applying for a 
given Job today' and the type of person who would have applied a 
few years ago? ' 1 

This question, asked only in late^ interviews, produced a variety 
of types of response. Four employers suggested that current applicants - 
wer6 more sophisticated, aware and confident, although the sophistication 
might' be superficial. Three suggested current applicants were less respon- 
sible and two of these mentioned that employeeis today will sometimes resign 
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"ra^ther than accept criticism or discipline. Two employers indicated that 
current applicants have different values and are not over- awed by s.uper- 

'vis'ion (regarded as a good quality). The follpwing comments were made 
only once: . . 

'They have a greater desire to read.' 
'They are less willing to relocate for a raise.' 
' »They won't unthinkingly work themselves to^death.' 

'They want to know why. ' » - ^ 

♦A greater proportion have a higher level of education. 
.'The females are more competent, th^ males are less competent. '«, 

Additional Observationd-iby Employ era 

During the course of the interviews several employers made obser- 
vations not directly related to the particular questions asked. A sampling 
of these is given below. 

"^Deficiencies start wit^ the teachers, who are themselves ill- 
^ equipped. " There is a general deterioration in the approach to English,, 
less adherence to rixies on the false assumption that correct English is " 
not necessary. ' ^ . 

»It is important that the teacher really, enjoy his work.'. 

'There is a general decline in English proficiency. This is.-not 
d'ue to the high schools alone. ' Even some educational -TV programs use 
« terrible English. Advertisements, songs and various ot^her sources all 
exert ^pressure against proper usage.' 

'There is a need for the art of proper oral and written communica- 
tion. ' - ^ 

'Speech habits are formed by the environment; as more of the 
•population becomes more educated, speech patterns improve. Therefore, 
' there is a general upward trend in proficiency.' - 

'There seems to be no compariscqi between the abiliniies of older, 
persons and those of younger persons. This is due to the failure of newer 
methods. ' - . _ - 



- 'Proficiency is probably no worse than it has ever been, but it 
should be mucTi better. ' ^ • * ' ^ ' , - * 
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/ . .Style is perhaps ,less disciplined than formerly. % 

Those who read a 16t are the best- communicators.'^ Probably the 
girls read a lot more than the fellows. Girls are becoming mor,e*and more 
appealing as employees in bus^iness because they have more aggressiveness. 
The rough edges of male graduates are getting. Rougher. ' 

'Sloppiness in language proficiency is just one facet of a general 
lack of -.pride in productivity.' 

'Vocabulary t«st scores are dropping. For many year^ our firm has 
admipister.ed a test made up of 200 questions, 90% of which afe vocabulary 
questions in various forms. There was a time when a person scoring lovrer 
than 100 woiild not be considered for a job. Today there are few high school 
students who get 100 questions done, let alone 100 right. On the other hand, 
university graduates easily score as high as 170.' 

(This observation points out a centtal problem in determining 
whether or not there has been any change in the English skills of high 
school students over the past few years. It is quite probable that, as 
• the.|)roportion of high school students who take post^high school train£ng 
rise!}, many employers aye faced with 2^plicants for junix>r p^b^itions whose 
native abili^es are less than those of similar .applicants torrter years. 
Therefore, what the employer observes as a decline in English skills of 
students in general is really a change in the type of person applying for 
work.) fc ^ 

^ » 

'In future, grammar may becOme unnecessary but 'at present it is' 
very important in business. Our firm has 200 emp,loyees who write letters. 

The well-read person stands out. * - 

♦ ^ II. PARENT SURVEY 

The 21 parents interviewed represent a variety of school .situations . 
In some cases parents' responses were fairly general because they were try- 
ing to respond in terms of more than one child. 

* Although most parents responded to all questions, it was quite 
evident during the interviews that they were, in most cases ^ generally 
vmfarni liar^with the English program in their child's school. Therefore, 
their, responses to several of the questions asked should be interpreted 
with this fact in mincj. 

^ ' . .' ' " 

Q.l What grade is your child in? , 

Fifty-seven percent of parents interviewed had children enrolled 
^ at the elementary level, 10% had children in secondary and^ 33% had children 
at bofh levels. . > ^ 
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Q.2 (a) What do you want your child to receive from an- English programe? 

The benefits Vnd percentages of parents mentioning ^*ch are as 
follows: Granunar. Fundamentals, etc., 71 ; Spelling, 29; Reading, inc ud 
ing appreciation. 29; Creative Writing, 19; Less Creative Writing. 10 
Vocabulary 5o; Dictlftnary Skills, '5; Poems, 5; More .Regimentation, 5. 

It is apparent that parents' main expectation is that the English 
programme provide their children with competence in tne^ technical aspects 
of language. 

' q:2 (b) Which is more important: job preparation (technical skills) or 
-cultural enrichment (study of literature^ etc.). 

Over fialf of the parents felt that job preparation was "jost 
important. Another 25% felt that they were equally important, but ^out 
half of these felt that grounding in mechanics should come first. Only 
10% felt that en/ichment was more important. 

k I 

Q. Z Do you 'feel your child is getting the things you think he should 

be getting from English? - ^ . 

About two thirds of the parents responded in the affirmative to 
this question. , 

q: 4 Are you fdmiliar with your child's English programe? 

Only about a third of parents responded 'Yes' to this question,- 
with an additional one quarter saying 'Partly'. 

C.5 (a) Do you have any suggestions for .improvement of the English 
programme? 

Vive patents suggested more emphasis on writing and grammar and 
two suggested that children shouLd be taught to ^P^ll Ph°"«?^" ^^-^^^^^ 
suggestions, made by only'one of the parents ; -included : make it more 
dfffSlt i; the -early grades; English should not be optiona in high 
school; the program should not be so slanted toward the creative child. . 
improve reading at the lower levels.^ '' ' 

Q.5 (b) What do you consider to be the strong points of the programme? 

This question was asked of only 13 parents. Six gave no response, 
Three said, 'Reading' and four different parents volunteered- 'Emphasis on 
lilVglnatlon'. ^The'elective system in high school', 'Cla^^ participation' 
/ and 'Pyblic speaking' * . ' ' . ,• 

• ' ■ ' / 
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qI 6 Do you feel that your child is happy with his English programme?' 
Fifteen of the 21 parents interviewed responded 'Yes' to this 



ion. 



(c|ue5ti 

jb. 7 Apart from school material^ -does your child read at home? 

i 

I About two-thirds of the parents indicated that their children did 

' some 'or considerable non-school-related reading at home. 

Q. 8 What does your child prefer to,, read? 

Parents' responses indicated that "their children ha4 a wide variety 
of reading interests, with no clearly dominant area or type of literature.. 



Q. 9 



Could your child* s spare time be used more profitably? 



About three-quarters of the parents said that their children made 
good use of their spare time. They reported that most children were 
heavily involved in a wide variety of extra-curricular activities. Some 
, J / parents felt that their children were too busy for their age. Although 

parents reported that^most children watched TV for two or more hours a day, 
only five parents w^re concerned that children watch too much t^levisicin. 
Two parents felt that television viewing was a -needed respite for their 
children's otherwise very active schedule. 



Additional Obs era at ions' by Parents 

One parent said that there should be an effort 'tp instil the 
intangible delight of reading'. This would improve the technical skills 
but can only be accomplished with the cooperation of the home. 

'■ L ' 

An immigrant service technician felt that the earlier grades are 

too easy and that his children ate not taught English as well as he was 
taught his native tongue. ^ 

One pajrent felt that the curricutiom should be -standardized through- 
out the city scJ^hat a child's education would not l?e upset when his family 
moves from one area 'to another. This same parent said that the standards 
in grade 7 in London are much higher than those in Toronto. 

A couple who spent .a year in England have a son who took grade 6 
at •the-regular-schcol-down-the-sireet ' when they were there. They said 
their son, who did well here , in London, seamed backward\in his command of 
the language when compared with his English peers. These parents reported 
fee'ling very envious of English students' language facility. } 
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III. CITIZEN 'SURVEY- 



Q. 1 ' When did you- leave school? 

Twenty-seven of the 'citizens' 'intervievfed had left school since 
1965, 16 had' left between 1955 'and 1965 and the remaining 11 'left befoie , 
1955. 

Q. 2 The teaching of English involves various oomponents (e.g.. Liter- 
ature, Grammar, Composition, Teachers, Materials, eta.}. Is there 
any one aspect that stands out in your memory? Why? 

Although ,.no. one aspect of English was mentioned by a majority of 
respondents, betweelfl^lO and 25% of them mentioned Literature and their 
teachers. In terms of tfeeir general attitude toward English, 9 expressed 
unfavourable attitudes antl 6ry/ere favourable. 

Q. Z Overall, did you' enjoy English in school? Uhy? Why not? ^ 

Slightly over half (56%) of the respondents replied that they had 
enjoyed English in school. About one-third , said they did not enjoy- English 
and the remainder had mixed feelings. 

Q. 4 ' What things did you like or dislike aboui^ English?^ Grarmar, 
Literature, Composition, Poetry, Memorization, Teacher, Other 

Citizens*> responses to this question. are summarized ifi-Table 2. 
It is apparent that the respondents liked^iterature and their teachers^ 
best and were least favourably disposed toward grammar and memorization: 

One or^Tnore respondents volunteered that they had li\ed debating, 
giving speeches and doing gto.ujf'projects . Additional disliked aspects 
mentioned were giving speedtes and doing book reports. * ^ 

5 Bow ehjoyable As reading for you? 

The gr^at majN'^'ity of respondents' (83%) rated reading as either an 
'erfjoyable' or 'very enjoy^ble'_^a?ctivity, ^ 

6 How many hours do you read per week? 

About one-half of the respondents indicated that they read £rom 
one to five hours per week; an additional one'-third reported r^eading from 
six to ten hours a week. The remaining one- fifth spend eycn more time 
each week reading. 
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'TABLEJ2 .Percent of 53 citizens giving each rating to 
/ various aspects of the inglish prograjn. ^ 



- / 



\ 

Program Aspect 


Rating 


like. 


Ambiv- 
alent . 


Dislike' * 


. Literature 




6 


^\ 19 


Teacher • ^ 


44 


28 : 


28 • 


•Grapnar 


• 57 " 


.6 , . 


55 ^ 


'Composition • 


''35^ . 


33 \ 


33 


Poetry 


35 


33 


• 3i 


Memorization 


^, 26 


26 


47 



Q. y What magazines and newspapers do you read? ^ ■ 

The. majority of citizens apparently re^d 'the local .newspaper, 
Ueekend Mag.azine and Canadii^n Magazine. Other publicatioi^, in ^reas 
such as Business and Financfs, News, Homemaking,- Science Technology , 
are read by 10 to^ 25% of thfe respondents. 



Q. 8 Do you have a libri 



?y card? ^-Hoy) often do you usesit? 

■ ' ' 

Le&s th^h half of those interviewed had a library card. V 

those 'who did have one, abcjbt three-qdar^ers reported^ frequent or occas 
use of it; the remainder riever use their library card. 



Of 

ional 



Q. 9 For what reasons di 



you readZ, 



Citizens apparently read primarily for entertainment and to acquire 
informataton. To a much lefeser extent they read^'to 'pass the time*, 'keep 
up*^ or because they are boiired, with TV. „ 



Q. 10 ^What type of hooks^do you^pref^r? ^ ^ . , 

Irf keeping witi), their response to respondents expreS^.ed clear 

preferences for fiction and information types of literature. Biography- was 

also mentioned by a few people. - ^ 



... - ' ' - ) 

Q. 11 How many pooks do you read in a year? 

Although 15% of the citizens apparently don't read books, 42% 
reported reading from 1 to 15 books per year and an additional 42% read 
more than 15 per. year. ' ' . 

Questions l^[^Mtfrntt 14, which inquired further into the subjects* 
opinions about booi^^^Hnot produce information of sufficient relevance 
to this stud>: to belBHuded in-thi.s report. 

Q. lb Did^ your education in English teach you how to evaluate the 
relative truthfulness things .in print? 

About half of the respondents felt that their education in English 
had helped them develop this skill. 



sie If you wanted to find out information about something^ how would 
yoTj go about it? 

' ; Replies to this question indicated that citizens rely heavily on 
the diet ionar/ and encyclopedia as' information sources.. About one-quarter 
'^use the public library. - , * • • " 

About 90% of respondents indicated that they had a dictionary at 
home and about 50% reported having an encyclopedia. 

Q. If Do 'you take evening ^ courses?. * • ^ 

- "jiM^ Approximatel/half of this Sjample'of citizens indicated some 

Vcurrent ot intended ii^volvement in evening classes. 

' * f< ^ • ' 

Q. 28 Do you enjoy letter-^writing? 



\ 



Slightly over half^ef all respondents indicated that they did not 
, enjoy writing letters. Another 20% said they ^enjoyed letter writing onl^ 
/sometimes'. ^' 

19 How often do you write a friendly lettefr? Do you have a substitute 
form of oorrmmioation? 

About one-quarter ofj^e subjects rej^orted writing one letter or 
fewer per year. About one-lfff reported writing about one letter per 
month. One-quarter qf them write two or'more letters per month. 



The telephone is used instead of letter writing by slightly less 
than half of those intelrviewed. About 5 to 10% of respon'dents* visit or 
use tape recordings as a substitute for writing letters. 

Q. 20 How Qften do you write a business letter? 

About 80% of all respondents write one or more business letters 
each month and half of :hem write two' or more per month. 

- 

q/ 21 Do you feel that the teaching of letter-writing in school kae 
been vc^uable to you?' 

About 60% of th^ citizens responded affirmatively to this question. 

,Q. 22 What language ekills that you learned in school do you apply tn 
,your job? 

Citizens' responses t;>^ this question indicated that, of the three 
types of skills they used in their job, oral .communication /^skills were 
mpst "importai^t, writing skills next, and reading and comprehension the 
least important. 

Q. 23(a) Do you feel comfortable in expressing yourself in a oonversation- 
• al situation? Can you get your point apross? 

Most respondents (85%) gave #ffirmatiye replies to th^^se~^^stions. 

2ilb) ' Do^you feel there was sufficient emphasis on oral communication 
in school? " • , 

J 'Only about 40% t)f the respondents replied in the affirmative to . 
tliis question. 

Questions 25 to 29 inclusive dealt with the subjects' invol\^gment 
-with TV and movies and their reactions to advertising. The- information^ 
developed by these questions was not considered sufficiently relevant to 
include in this particular paper. 

Q. 30 What aspect about your own ability ^ to use English would ygu like 
improved most? 

» 

\ * The areas for improvement mentioned by the respondents and the 
percent of respoidents mentioning each are as follows y oral communication 
(30%), written communication (20%), voc:abulary {lB%) , grammar (10%), and 
Reading (8%^ . 



SUMMARY 



This study involved structured interviews with 17 employers of 
graduates of the- London School System, 21 parents of school-aged children 
and 53 'citizens' who were neither employers nor parents of school child- 
ren. All interviews were conducted during the months of February^ and 
March, 1973. ~ , * . 

"The employ e^vs -generally do have certain minimum l£iguage require- 
ments for the various positions in their firms and many of them use 
employment 'tests' of certain language skills. Employers regard speaking 
and reading skills as important biit seemed most concerned about writing 
skills. They are generally diSsatisifed with the writing ,skills of job 
applicants and feel that there *has been a general decline. in proficiency 
in' recent years. ' ^ ^ • 

\ . \ 

Although parents do not appear to be very knowledgeable about 
their youngsters' English program, the majority of them seefn'to be satis- 
Vied with it and fee J that their children ^are happy with it. Parents 
J seem most concerned that their children become , prof icient i4i mechanical 
*'l%a^uage skills, especially in so far as these skills ^re related tc^ 
preparation for employment. ^ 

^ Citizens' memories of their experiences in the English program 
^re about equally positive dnd negative. They tend to remember grammar 
in unfavourable terms but literature and their teachers favourably. At 
present they enjoy reading and read a good deal... primarily to acquire 
information and as a form of recreation* Most of their reading tends to 
consist of local newspapers and works of fiction. The group of citizens 
interviewed write a fair number of both friendly and business letters and 
ovJr half of them indicated that the instruction they^'received in letter 
writing at school has been helpful to them. In terms of importance on 
the job, they feel speaking^ comes first, writing next and reading last. 

* Although the interview survey reported in this pap^r was not 
designed to be either representative Qf the community or comprehensive 
in the segments of the community sajTipled,'''it did detect major concerns 
in three significant groups about the English program.^ 



APPENDIX A 



LONDON EMPLOYERSi^BY TYPE, VaRTICIPATING IN THE 
COMMUNITY ATq^IJ^DE SURVEY 



Clerica t S Related Fields (13) 

. — , . ; 

Canada Trust 
'Xity Hall 
JEitfco 

'/London Free Press 
London Life Insurance'Co. 
MacLachlan Employment Services 



Matthews Group ^ 
Media Center - Board 
Education 

Patto^'s Place 
Post Office 
3M 

Victoria Hospital 



^ 1 ' ' 
Sale» (2) 



Bob's TV 
Simpsons 



Technical -product ion 12) 

Kellogg' s (Plant Personnel Officer) 
McManus Motors (Pfi4ks & Service department) 
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INTERMEDIATE ENGLISH EVALUATION •t'ROJECT: 
SURVEY OF STUDENT ACHIEVEMENT - OVERVIEW 

Research Report 74-07 

R. G. Stennett, Ph.D. 5 Loma Isaacs 
Educational Research Sej^ices 



This survey constitutes one major component in an overall plan, 
designed to assess the current status of London's Intermediate English 
program and to produce recommendations for future developments in both . 
curriculum and methods. The project is led by a Central Committee 
composed of the consultant in English, an administrator from Curriculum 
and Planning, elementary and secondary teacher representatives and 
support staff from Educational Research Services. Ad hoc subcommittees 
of local educators have contributed importantly to various aspects of 
the work. The project is being condft^ted in consultation with a Ministry 
task force concerned with developing^ an Educationa^ Resources Allocation 
System (E.R.A.S.). 

After an initial series of organizational and planning meetfdgs 
separate surveys were undertaken* to assess^ community attitudes towards 
the products of the English program; student attitudes pward various 
facets of English instruction, and the views and opinion? of the faculty 
involved in teaching Int'ermediate-level English. ^ A special group of 
educators devoted substantial effort toward defining and specifying the 
goals and objectives of the program in terms of t^e four broad areas, as 
established by N.C.T.E.^ of Reading', Writing, Speaking, ^nd Listening. 

This survey was designed to assess the degree td which students 
are currently achieving some of the major goals of the 'program. 

A larger and more broadly representative committee will be 
established to review the findings of all six sub-projects and to form- 
ulate recommendations for the senior administration and Board of Educa- 
tion. • 

The purpose of this paper is to describe the plan of the study, 
the program goals selected for study, the testing procedures used,^the 
selection of students and the representativeness and comparability of 
the various subsamples of stifdents participating in the project. It 
constitutes a general preface to a series of papers which will describe 
the findings related to each program goal in great detail. 



*Mr. Lome Dickie, Mr. Gordon Sleightholm, Mr. Norman Waite, Mr. Gerry 
. Clift and Dr. R. G. Stennett. 

^Natdonal Council of Teachers of English. * 
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METHOD ■ 

General Strategy ^ * ' 

Because it was manifestly impossible, with the time and material 
re'sources available, to 'measure the achievement 6f all students on all 
of the 54 specific objectives identified as appropriate for the Inter- 
mediate English program, sampling procedures had to be employed. Therefore, 
in order , to ensure as reasonable and representative ssimpling of both goals 
and students as possible, the following generi^l guidelines were adopted: 

(a) at least som.e goals should be seletted from each of the major - 
areas of the jjrogram, namely, reading, liriting, \ listening, and speaking; 

(b) the selection of goals to be' evaluated should not be deter- 
mined by the read>^ availability of suitable stamdardired tests; 

(c) a minimum size sample of students snould be tested to ensure 
that there were at least 100 students tested on each test at each grad^ 
level ; 

(d) clasMS for testing should be selected randomly with the sole 
constraints that, at the elementary level, geographical sectors were rep- 
resented propottiQnately ands at the secondary level, there would bepro- 
portional reprisen^tion by type of secondary school and enrolment/In 
level 4 (general) and level 5 (advanced) prograas; 

(e) only students in regular .classes should be tested; 

. (f ) to ensure maximum reliability and validity of measurement all 
testing should be done by specially-trained substitute teachers; 

(g) the testing proc'edures should be tailored so that no more than 
three class periods would be required of any one student, and 

* 

(h) that, whenever feasible , students at the secondary level should 
be tested during their regularly-scheduled English classes. 



Subjects 

The subjects for this study were 2,684 students distributed by 
grade and sex as shown -in Table 1.^ T^ble 2 gives these same figures as 
percentages of the corresponding population figures. As is evident from 
Table 2, approximately 21% of grade 7 and 8 and 15% of grade 9 and 10 
students were tested. Within panels, the sample is quite representative 
of the population in terms of its grade and sex distribution. 

Because it was impossible to give all students all tests, the 
sample was broken down into five subsamples, each of which was to receive 
a different battery of test-s. Classes were assigned randomly to the five 



TABLE 1 Number of students tested by grade and sex. 
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1 . = 
Grade 


V 

Total 


7 


8 


9 


10 


Male 


376 


334 


338 


309 


1357 


Female 


357, 


370 


300 


3t)0 


1327 


Total / 


733 


704 


638 


609 


2684 



TABLE 2 Numoef of cases in the sample students tested is a 
percentage of the correspond Jng gr-ade-sex populations. 





'Crade 




Sex 


7 


8 


9 


10 


Total 


Male 


, 22.5 


20.2 • 


15.7 


14.4 


17.8. 


Female 


21.2 


22.7 


15.4 


16.2 


18.7 -• 


Total 


21.8 


21.4 


15.5 • 


15.3 


18.2 



subsample or battery groups with the following constraints: at the elemen- 
tary level, the geograpHcal areas or sectors should be proportionateJy 
represented in each subsample; at least one, and no more than two. classes 
'from each sector be included at each grade level in each subs amp lev, and 
that after initial selection of grade 7 classes, grade 8 classes be^ taken 
from the same school. At' the .secondary level, the proportion of level 4 
and level 5 classes withinl-each subgroup should reflect the proportions ot , 
all such classes in grades > and 10. Also .the number of classes sefected 
from each type of secondary school (technical, academic, composite) ^shoOld 
be reflected proportionately in each subgroup, with at least one sc^ol of 
each type being represented in each subsample. 

■ The final selection of classes was reviewed with and approved by 
administration and the principals of the schools involved. Minor changes 
were made tq accommodate scheduling difficulties or sp«^ial probl^na. 

In sum each battery of tests was administered to five glasses at- 
each of the four grade levels from 7 to 10 inclusive. Since there >-ere 
five different batteries, a total i)f 100 classes were tested. 



I 
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Tl>e fact that the^ design of this study is * cross-sectionar rather 
than * longitudinal* introduces at leafet one important limitation'. Since 
there i*s a selective or 'non-random attrition of students in grades 9 and 
10 due to early school leaving and since, in grad^ 9, the school system 
enrols significant numbers of students from the separate and other sur- 
rounding systems, the characteristics of the elementary and secondary 
samples are necessarily different. This iinplies that at least part of the 
differences in skills and attitudes apparent between elementary and secon- 
dary student? may be due to either the selective attrition of less capable 
students and/or the addition of students from other systems. This, in 
turn, means that C9nsiderat>le caution is necessary in interpreting * grade* 
trends as * growth* trends. While the sampling jprocedures are designed to 
ensure that students at each grade level are representative of all students 
at that grade level i the cross-sectional design of .the study does ndt allow 
one to conclude, for example, that the performance of the grade 9 students > 
is necessarily what the current grade 8 London student;s will /achieve when 
they enter grade 9. 

Teat Administration l 

All tests were administered ^ix specially trained substitute 
English teachers working under ,the sjipervision of two research assistants^ 
during the period February 11 to Mfrch 4, 197^. A full week of training 
was given and each tester was provided with ^ manual which outlined all 
the testing procediyres in great detail. 

All tests, S'xcept those for oral reading "^d oral communication, 
were given to regular classroom groups during their normal English class 
periods. The classroom teacher was presenf*during testing to assist the ^ 
tester, and was asked to complete a' form outlining his or her evaluation 
of both the class and the tests being "given. * 

Students were tested individually on oral reading and coramuriica- 
tion ^ski41s,' primarily by one tester.** 

Immediately after each testing session each examiner rated its 
adequacy in terms of^ student effort, freedom from interruptions, and 
the positiveness of the class attitude toward doing ^he tests. 



^The Committee wishes to extend a special word of thanks to the substitute 
teachers for their conscientious and dedicated effort as testers on this 
project. They are: Mr. Tezp:y Benbow, Mrs. Jean Buchanan, Mrs. M^rylou 
Cunningham, Mrs. Pamela Hyroann, Mrs. Pamela Thompsbn and Mrs. Marilyn 
Wearring. ^ 

Mrs. Adk Yairbaim and Mrs. Loma Isaacs were responsible fox the training 
of testers and the supervision of their work. Tbey also took responsibil- 
ity for the very difficult task of scheduling all of the testing sessions. 

**Mrs. Pamela Humann, 
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Testing Instruments ' > 

The ^election of tests, done by the Central Commit tee^was based 
upon the 17 general objectives to be evaluated. In those instances in 
which a suitable standardized test was not available, an appropriate test 
was developed. 

In order to judge X\ie representativeness and balance among the 
five subsamples, all students were given an initial testing session which ^ 
involved completing a 40-item multiple choice*" vocabulary test (Comprehen- 
sive Test of Basic Skills: Test 1 - Form Q - Level 3 or 4, 1968 Edition), 
and a 30-itera, locally-produced attitude scale composed of 6 subscales 
designed to assess sti^ent attit^^^s toward "various facets of the English 
program. Students used a specially ^signed NCS answer sheet to give their 
responses to these two tests and, in addition, indicate their name, birth? 
date, sex and grade. 

The remaining tests were grouped into five batteries, primarily to 
ensure that they cf>uld be completed within one or two normal clas,s periods. 
In §ome instances, only parts of some scales could be administered 'because 
of time limitations. 

In what follows, each of the program objectives studied will be 
stated' along with a brief description of the test(s) used to assess the 
degree ta 'which students are achieving it. Objectives are grouped in terms 
of the four broad dfeas of reading, writing, listening and .speaking. With- 
in each area, a distinction is made between attitudinal and .skill outcomes. 



Attitude 



Ar READING 



Objective: To develop in students a desire to read for enjoyment* 
Students* enjoyment of reading was measured by a 6-item Likert-type atti- 
tude scale. 
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Skills 

Objective: To have students acquire a level of vocalmlary which 
fulfills their needs. The vocabulary subtest of Form Q of the Comprehen-, 
sive Test of Basic Skills (1968 edition) w^ used. This is a 40-item, 
multiple choice test with one level appropriate for grades 7 and 8 and ^.^^^^^ 
another\level for grades 9 and 10. ^ » , ^ ' 

Objective*: To have students acquire the ability to understand 
literal meaning; to follow .a line of reasoning and to make valid infer-- 
ences. Students .were given the Sequential Tests of Educational Progress 
(STEP) Series II Reading Test (1971), which consists of 60 multiple-choice' 
type items. The items can be grouped for analysis into three types which 
reflect students' (a) 'Comprehension, the ability to understand written 
material...', (b) 'Translation and Inference, the ability to identify ideas 
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when' they are^ stated in language different from the* origins^l presentation; 
I to deduce the" meaning of figura*tive or obscure words...', and (c) ^Analysis, 
the ability to recognize and appraise (1) literacy devices...; and (2) the 
author's purpose...'. One form of the test was given to students in grades 
7, 8 and 9; a more advanced form to grade 10 students. v . 

Objective: To have students aaqui^e^ researoii skills including 
skim reading^ uses of tables of aontentSy ifidiaeSy headings^ dictionary 
and library skills^ eta. Students were ^iven subtest W-3\of Form II of 
the Canadian T§st of Basic, Skills (1968), Thi-s subtest contains 75,/ 
multiple-choice items designed to measure students' skill in. the following 
eight areas: Alphabetizing , 'Using Guide Words, Using the Index, ^JJsing Key 
Words, and Using General Reference Materials. One level" of the tefet was 
administered to grade 7 students and a more advanced level to students in 
grades 8, 9 and 10. Although this test was not designed for high s*chool 
students, its use in this project was deemed appropriate. 

Objective: To have students develop the ability to read orally 
with expression^ rhythm^ clarity and proper intonation. Students" were 
given parts of the Gilmore Oral Reading Test (1968) and their response was 
tape-recorded. This test consists of a series of paragraphs of increasing 
difficulty which students, tested individually, are simply asked to read 

• aloud. The examiner records the time the student takes to read each para- 
*^raph and counts the occurrences of eight different types of error. A 

. different examine^ listened to 'the tape of each student's performance .and 
rated it on a 'simple scale for quality of expression. 

Objective: To have students learn to recognize and be aware of 
different levels of meaning beyond the literal. Students' success in 
achieving this goal was ass^essed by using a preselected set- of items from 
the STEP II Reading Test described libove. 

* Objective: To develop students' ability to follow written instruc- 

tions. Students' mastery of this skill was assessed by rating the extent 
to which they were able to follow written directions on a writing assign- 
ment . 



B, WRITING ' 

Attitude ' 

To develop in students an enjoymeni pf writing^ 
Students enjoyment of writing was assessed using a simple, locally- 
developed attitude sc^le consisting of 3 Likert-type items. 

Objective: To develop in students an acceptance of and preference 
for the conventions of usage; spelling^ sentence structure^ punctuation^^ 
paragraphing and essay writing, but an abiliti^ to violate these conventions 
appiK>priately , Students attitudes toward conventional correct expression 
were asseised using two locally-developed attitude scales. One scale, 
' caUed 'Us-efulness of Grammar', contained 5 Likert-type items; the other, 
' 'Application of English Skills', contained 4 such -items. 

ERIC 



Skills 



*Obj/ective: To have ^^dents' develop skill in writing exposition^ 
narrative J description an^'aiyuTnent. 

Objective: To have shidehts develop precision yn written language; 
to make calculated choices among words and word groups; . to differentiate ^ 
shades of meaning among alternative expressions; ^ to be able t^'use^stan- 
^dard reference books of English usage. 

i 

Objective: To have students be able to use the conventions of 
usage, spelling, .sentence structure, punctuation, paragraphing and essay 
writing in an appropriate manner. 

Students' attainment of these goals was assessed primarily by 
having them complete a writing assignfceivt, namely^ writing a business 
letter. This assignment, done during a class period under the supervision 
of a tester, was presented to students as possibly contributing to their 
telrra mark in, English. 

^ Students' productions were corrected for format, spelling and 
graj^piatical errors by two experienced English teachers using a specially- 
prepared marking scheme. Each student's production was also rated on 8 
simple scales, namely, presence of,' and support for, a central theme; 
organization; sentence structure; clas^lty and effectiveness of communi- 
cation; imagination, freshness, vitality, richness; ^laifdwriting ; 
following directions; and use of appropriate letter format. 

In addition to the writing assignment, students were given certain 
subtests of the Comprehensive Tests of Basic Skills (1968), Form Q, Level ^ 
5^ or 4/^Co^^^ay5ess their knowledge of: punctuation," capitalization, 
grammsfr, anfi Spelling. These tests contained a total of 75 multiple- 
choice items. ' ^ 

I " *• C. LTSTENim 

Attitude * , 

No objectives were ^sses^ed with respect to attitudes toward 
listening. • ^ , * 

Skiirls - . o • . 

Objective:" To have studeMs be able to fallow a nerbat presenta- 
. .tion and: ' (a) assess'^a speaker'^s infoifnatypn, qualifications, intentions, 
and'pres'entation; (b) ' decide to accept or reject any^ part or the whole of 
a speech, i.e., to decide: (i) whether the speaker fs informed or mis- 
infoifned (ii) whe'ther the speech is logical or illogical, effectively or 
'ineffectively pres^nt^d, and (Hi) whether the various points made by the 
speaker ur^ reievOfit or irrelevant, complete or incomplete. 



The, extent of student achievement of this goal was assessed by 
administering the STEP Listening Test fl957). Form *3A was given to , 
students in grades 7, 8 and 9; 'Form 2A to grade 10 students. Due to 

>time limitations only 66 of 80 items of Form 3A could' be administered 
and 60 of 7-2 items of Form 2A. The items compromising this test can be 
grouped to assess"" three major skills: plain-sense comprehension, inter- 
pretation, and evaluation and application^. Smaller clusters of items 

.can be used to assess most of the specific^ skills outlined in the goal 
statement above. - 

^ In this test students listen to brief passages of different kitids^ 
of material and, after each, answer a brief series of multiple-choice 
questions. 

D, SPEAKING 

Attitudes ' * « . 

Objective: To develop in students an enjoyment of speaking and 
a willingness to express their^ opinions and ideas honestly; to develop 
confidence in speaking in piiblic. This goal was assessed by having 
students complete a 6-item, locally-developed attitude scale called 
'Self-confidence in Speaking'. * - ' 

Skills , . . / 

Objective: To help students develop a flexible and clearly audibl 
speaking voice. 

Objective: i'o have students develop the abi^lity to ask pertinent 
questions and give pertinent answers. * 

, The degree of student attainment of these goals was assessed by 

havijig student's participate > one at a time, in a short, structured, tape- 
recorded conversation with an examiner. 

' ' i ■ 

Each student's performance was subsequently /marked' for correct- 
ness of expression ^nd rated on 3 simple scales fon: general effective- 
ness, peijtinence, and quality of speech. ^ ' 

E. VERBAL CREATJViry " • 

In addition to the ^titudes and basic skills outlined above an ^ ' 
attempt was made to assess students' ability 'to think hypothetically ^ 
j^reatively and in an open-ended manner^ by administering two subtests of 
the Verbal form of the Torrance Tests of -Creative Thinking (196?), namely, 
Asking Questions and Unusual Uses. These two tests allow some estimates, 
of the fluency, flexibility and originality of students' thinking. 



F. ATTITUDES TOWARD ENGLISH 
f ^ 

Attitudes of students "^toward English as a subject were assessed ^, 
by having them rate their Jiking for, and difficulty with Science, Mathe- 
matics, Geography, History and English on 5-point Lik6rt scales. They 
also completed a 6-item, locally-produced scale designed to assess their 
'Enjoyment of English Classes'. 



Orgdnizgtion of Teats into Batteries 

# 

Since it was impossibl-e to administer all tests, except the 
vocabulary and attitude scales, t^ air students, the remaining 9 tests 
were organized into 5 batteries as, shown in Table ^3. The grouping of 
tests was based prirafiriiy upon the need to have them fit within the time 
* limits of a typical high school iclass period. 



TABLE 3 Organization of Tests inta Batteries 



Battery 


Tests* 


Number 
of :Test 
Sessions 


I 


J Canadian*Tests of Basic Skills^Form H - • ' 
Subtest. W3. • * 


1 


II 


Torrance Tests of Creative Thinking -.Subtests 
1 and 5.1 

STEP Series II Reading Test § . ^ 


2 


.HI 


STEP Listening Test 


" 2 . 

1 


IV 


Comprehensive Tests of Basic Skills - Subtests 

3, 4 and 5. 

j 


1 


V 


Writing Assignment 

Gilmore Oral Reading Test " \ 
' Oral Corarnijinication Test 
Liking an^ Difficulty Ratings 

! 

* * ! 


1 

plus' 
individ- 
ual 

testin'g 



*In their first testing session all students wereafven the 
Voca]?ulary subtest of the Comprehensive Tests of Basic Skills.' . 
and a 3Q-ltem Attitude Scale. In addition, they provided, via 
"an NCS answer sheet, their name, brirthdate, sex and grade. 
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'Since all students, had the same initial testing session in whi£h 
they were given vocabulary *and attitude scales, each participating student 
was -tested for either 2 or 3 plass periods. 



Test Scoring 

Students* responses to all objective-type tests were scored using 
a,NCS| scanner and IBM 370 computer with" programs written especially for 
each test.^ The scoring programs were designed to create a series of su]?- 
scale scores -for groups of items within any test which measured ^ecific 
skills. A count of the number of items each student attempted on each 
subscale was calculated as well as tKe number he got correct. Whenever 
possible, percentile norms based on the original standardization samp^fe 
were also computed. However, since most tests will be used primarily as 
mastery tests, the pertinent refer^i^e points for j'Udgine the adequacy 
of students* performance will be developed locally. \ 

\ i 

Locally-developed and individually administered testX and the 
Torrance tests were corrected or scored by hand by two experi^ced English 
teachers using special ly-developed marking schemes or rating sc^es. This 
information was subsequently punched. into data cards for tabulation and 
analysis by computer. The, marking schemes or rating scales for all locally- 
developed tests were checke^ initially for inter- rater reliability an^^pot 
checked thereafter to ensure reasonably consi.stent marking and rating \^ 
standards. 



Data Handling and Analysis 

•Data derived from all tests and ratings, whether collected via 
NQS scanner Sheets or by a manual process, were keypunched into cards > 
verified and all subsequent tabulation and ^analyses done by computer. 

After the resulting card files had been edited, frequency distri- 
butions and basic descriptive statistics were calculated for each item, 
rating, subscale or derived score for every * test separately by grade. 
These calculations were done twice; in the first run the tabulation 
procedure treated a student's lack of response to an item as a' mistake; 
in the second run the tabulations for each item incfuded only those 
students who actually tried it. 

In order to investigate possible sex and grad^ differences in 
student performance, the data were sorted^nto eight sex-grade groupings 
and one-way analyses of variance done to test for difference's among the' 
eight sets of means for all subscale, summary or total scores. * • 



^The -Committee is indebted to^Mr. Wayne Kelly of Computer Services for his 
invaluable help in writing special computer programs and assisting with 
all data processing aspects of -the project. 
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For each of the five batteries of tasts, students' scores on all . % 
tests' and subtests, including the vocabulary and attitude scales, were 
intercorrelated. These calculations permitted a direct examination of 
possible rerationshdps among the various sets of ability, attitude and 
skill variables. 

In order to assess the degree to which the f^^^ subsamplas of 
^ students (which were given th^ five different batteries of tests) were 
comparable, a series of two-way analyses of variance (grade X test battery) 
was performed on several key 'control' variables, namely, age, sex, vocab- 
ulary and attitude' scores, tester ratings of the adequacy of the testing 
sessions, and teacher ratings. 
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RESULTS 

Since the detailed findings from all tests are simply too volumin- 
ous to include in this report, a series of papers has 1?een prepared des- 
cribing student performance on sets of tests, grouped according to the 
major goals "of thq Intermediate English program. The results presented 
in this report will be limited tp those bearing primarily on the general 
representativeness of the .sample of students tested and the comparability 
of the five subsamples. 



Student-level Analyses 



Table 4 shows the number of students given each battery of tests 
at each grade level. 'All subsequent analyses of variance (ANOVA) described 
in this section are based upon the scores of all o'f these students*. .. the 
basic purpose being to determine the extent to which thp five battery- 
groups ^re comparable on th^e key variables likely to influence students' 
performance on the various ^ill measures. Since each cell in Table 4 
represents 5 complete classes of students, a total of 100 classes was 
tested. 



TABLE 4 Numbers of- students given each of five different batteries 
of tests at each grade level. i 



/ 

Grade/ 


— — 1 

Battery 


Totals 


I 


II 


III . 


\iv 


■ V. 


7 


159 


• 145 


151 


133 


.145 


733' 


' 8 


138 


154 


144 


132 


136 


704 


9 


120 


129 


lis 


144 - 


130 


638 


'lO 


129 


106 


118 


128 


129 


610 


Totals 


546 


. 534 


528 


537 ' 


540 


2685 
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^ . Chronological age. Table 5 shows the mean chrono logical age of 
the students at time of testing by grade-battery groups. A two-way ANOVA 
test^ (griide X battery) -reveale^ a very significant trend for grade but 
no significant differences as a function of .battery and- nq significant 
interaction effect. The .significant grade differences were, of course, 
to be expected and the "actual average ages of the students at the succes- 
sive grade levels (12-9; 13-9, 14-10' and 15-10) are.typical for the 
system. These findings. indicate that the five groups of students given 
different batteries of tests are very weM matched in terms of age. 

✓ 

TABLE 5 Mean chronological age of .students, in months, by-grade- 
battery groups . 



Grade 


Battery 


I - V 


r 


II 


III 

f — 


IV 


V 


7 


152 


153 


154 


• 1'54 


153 


153 


8 


• 165 


165 


164 


165 


164 


165 


9 


179 


• 176 


177 


178 


■ 179 


178 ^ 


10 


188 


189 


190 


189 


190 


190 


7-10 


171- ' 


171 


172 


172 


172 


172 



Sex. Since sex was coded 1 for male and 2 for female, it was 
possible to perform a two-way ANOVA (grade X battery) for this variable. 
The mean values for this variable for the 20 gra^e-battery groups of 
students are given in Table 6. Because of the coding procedure, a mean 
value of 1.50 represents a group composed of equal numbers of boys and 
girls. Values less than 1.50 indicate the presence of more boys than 
girls; values greater than 1.50, the presence of fewer boys than girls. 

^ The result^ of the ANOVA tests revealed no significant differences 
as a function of either grade or battery and no significant interaction 
effect. This means that the five groups of students given different batt- 
eries of tests are very comparable in terms of their sex composition. 
Since there are frequently substantial differences between the performance 
of boys and girls on. language tasks, this finding represents an important 
reassurance that any differences in student performance on the various 
batteries or at the various grade levels are not related to differences in 
the proportion of boys and girls making up these groups. 

7* ' 

^The Committee wishes to thank Dr. R. Gardnet and' Dr., P. Smythe for making 

this program available and assisting with the processing of the data on 

the University of Western Ontario computer facilities. 



TABLE 6 Mean values, for grade-batteiy groups on the variable sex 
(male coded 1; female coded 2). 
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Grade 


Battery 


, I - V 


I 




III 


IV 


V 


7 


1.45 


1.48 


• 1.46 


.1.53" 


1.53 


1.49- 


8 


1.53 


1.54 


1.57 


1.44 


1.54 


1.52 


9 


1.43 


, 1.53 


1.52 


1.46 


1.42 


1.47 • 


10 


.1.50 


-1.56 


1.42 


1.48 


1.51 


1.49 


1 7-10 


1.48 


' 1.53 


1.49 


1.48 


1.50 


1.49 



i\Vooabulary . .'rtiis test was administered to all* students not o^ily 
to assek^ one of the specific goals of the English program but also to ^ 
measure general verbal ability. (A measure of vocabulary is included in 
most individual and group intelligence tests.) 

The Vocabulary subtest of the Comprehensive Tests of Basic Skills 
IS a timed test composed of 40, multiple-choice type items. The test is 
composed of a series of levels of varying degrees of difficulty. Grade 
.,7 and 8 ^t^dents are given level 3, with -a 12-minute time limit; grade 9 
"and 10 students take level 4, with an 11-minute time limit.. Percentile 
scores, based on the American standardization sample, ^re provided by the 
publisher. 

Two ANOVA tests we^e conducted to assess the comparability of the 
stu4ents in the 5 battery-g^ups on the vocabulary test: (a) number of 
items completed by student^ and (b)- their performance as reflected «in 
their percentile equivalent scores. 

Table 7 show$ the mean number of items on the Vocabulary Test 
empted by studenl^ in various grade-battery groups. A two-way ANOVA 
est (grade X battery) revealed no significant differences among students 
as a function of the battery of tests they took and no significant inter- 
action effect. There. >fas a significant ^effect for grade. It is apparent, 
from Table, f, that th^ more senior students taking^ e^ch form of 'the test 
(grades 8 and 10) at^mpted more items tfian those in the corresponding 
lower grades (7 and 9). This effect is not unexpected and has no partic- 
ular implications for the current study. In general, most. stuckhts were 
able to attempt all but the final one or, two it^ms of th^j^af:aimlai'y , 
test. ^ , 
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TABLE 7 Mean number of Vocal?ulary test items attempted' by students 
in the various grade-battery groups. 



• -'at ■ 

OVade 


Battery 


I - V 


I 


II 


• III 


IV 


V 


7 


39.0 


38.4 


39.2 


38.3 


38.8 • 


38.7 


8 


39.4 


39.4 


39.7 


39.2 


39.3 


39.4 


9 


• 38.1 


38^0 


38.0 


38.7 


38.7 


38.21 


10 


39.4 


38.8 


38.9 


38.7 


38.7 


38.9 


7-10 


39.0 • 


3S.7 


38.9 


38.7 


38.9 


38^8 



Table 8 shows the mean percentile score on the Vocabulary test 
for students in the various grade-battery groups, A two-way ANOVA (grade 
X battery) test revealed significairt effects for both grade and battery 
and a significant interaction effect. An exanination of the means reveals 
tbat elementary students generally received higher ^scores on the test than 
secondary students. Students who were given battery I got substantially 
'4iigheor scores than those receiving battery IV. 

Although these data indicate that the entire group of students is 
probably fairly^ representative of students in general (mean p>ercentile of 
52), interpretation of both grade trends in student performance on the 
various tests and differences in .student performance ainong tests included 
in different batteries will have to be made with caution. 



TABLE 8 Mean percentile score on the Vocabulary Test for 

students grouped by grade and battery of tests taken. 









Battery 


* 






Grade 


I 


II 


III 


IV 


V 


I - V 


7 


56 


'53 


56 


49 


50 


53 


8 


56 


52 


60 


54 


S6. • 


56 


9 


51 


55 


47. 


49 


50 


51 


10 


57 


50 


48 


46 


47 


50 


7-10 


55 


52 


53 


49 


51 


52 
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Attitude. Students* 'Enjoyment of English Classes' was ^sessed 
using a brief scale composed of 6 Likert-type items which allowed \stu<ien^s 
to 'agree strongly, agree moderately, disagree moderately or^^jUsag^ee t 
strongly*. The scale was scored in such a way that a student's sco\e 
could range from 6, if he 'strongly agreed' with each positively-woi*ded 
item, to 24 if he 'strongly disagreed' with each item. Thus, the lower 
a student's score the more he 'enjoys English classes*. A student whose 
response, to the items was evenly balanced between agjreeing and disagreeing 
would obtain a score of 15. 

Table 9 gives the mean scores of students in the various grade- 
battery groups on the 'Enjoyment of English Classes' attitude scale. A 
two-way ANOVA test (grade X battery) revealed both statistically signifi- 
cant grade and batxer>' effects as well as a significant interaction. An 
examination of the data of Table 9 shows that students' enjoyment of 
English classes is greater at the secondary level and that this effect is 
generally true for each of the five different battery groups. It is also 
apparent that, with the exception of those in grade 7, students who were 
given battery IV reported greater enjoyment of English classes than the 
other groups. The possible effects of these difference^^ln attitude on 
students' performance on the skill tests is difficult to envision^ In 
any event, some caution in interpreting grade and test differences is 
indicated. 



TABLE 9 Ntean 'Enjoyment of English -Classes^' Attitude .^ale 'scored of 
students grouped by grade and bsattery of tests taken. 



Grade 


Battery ^■ 


I - V 


I 


II 


III 


IV 


V 


7 


16.1 


16.2 


16.6 


18.0 


16. 1 


16.6 ■ 




17.1 


16.2 


16.4 


16.0 


17.9 


16.8 


9 


15.5 


15.7 


14.3 


14.1 


■ 14.7 


14.9 


■ 10 


15.5 


16.0 


16.0 


13.4 


16.7 


1?.5 


7-10 


16.0 


16.0 


15.8 


15.3 


16.4 


15.9 



Class-Level Analyses 

Tester ratings. At the conclusion of ea^ testing session each 
examiner completed a simple Test; Session Evaluation Sheet. The form 
basically required ratings of the adequacy of the/ test session in terms 
of three simple rating scales: (1) degree of effort students put into 
doing the tests... a four-point scale from 'good, ^ conscientious effort' ^ 



- 16 



ERIC 



to 'gave sufficiently little effort to perhaps invalidate the tests'; 
(2) degree of freedom from interniotions. . . a four-point scale from 'no * 
interruptions at all' to 'serious iW^erruptions , perhaps invalidating 
the testj^'; (3) general attitude of the class... a five-point scale from 
' very^'^-^tive ' to 'very negative'. 

iizxce each grade-battery group included five classeST there were 
five tester ratings for each of these group?. And, since all students 
took part in at least two testing sessions, it was possible to check, 
using ANOVA tests, whether or not there were significant differences 
among the various grade-battery groupsr>in students' response to the 
testing jpftocedures. \ 

^^Silice the testers mad^ the three ratings described above on all 
students for at least two test sessions, two-way ANOVA tests (grade X 
battery) were made for a total of six ratings. .None of the tests indica- 
ted statistically significant differences as a function of grade or battery 
and no significant interaction effects. 

The mean ratings indicated that the great majority of testing 
sessions went smoothly with no marked tendency for the adequacy of the 
testing sessions to be associated with either the grade level of the 
students or the particular battery of test's they \jfere administered. There 
were, however, several instances in which the participation and cooperation 
of students left "a good deal to be desired. 

Teacher ratings. During the timi students were working on their 
initial set of tests the classroom teacher was asked to rate the class, 
relative to other classes at th&t grade le^vel, on three, simple 3-point 
scales covering academic ability, enjoyment of English and level of English 
skills. Two-way ANOVA tests (grade X battery) for each of the three rat- 
ings failed to projiuce significant differences for grade or battery jor a 
significant interaction effect. This finding indicates that, in terms of 
the teachers' perceptions, there were no systematic differences among 
students in ability, attitude toward English, or English skills related 
to either the grade in which they were enrolled or the set of tests they 
were given. % 

This report, a preface to a series of detailed reports of student 
attitudes and achievement in English, has outlined the general strategy 
of the project, the sampling of students and the procedures used in 
administering the tests. 

A detailed description of the tests used to assess the stated 
attitudinal and skill objectives of the Intermediate English program was 
provide*d. This presentation was organized in terms of six maj9r areas, 
namely, Reading, Writing, Listening, Speaking, Verbal Creativity, and 
Attitudes Toward English. 

/ 

i >3 r - 
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The organization of the tests into five batteries administere'd 
to five, 'randomly selected groups of grade 7 to 10 students was described.^ 
Test scoring and data handling procedures were outlined briefly. 

The results of a series of^analysis of variance tests, designed, 
to assess the • comparability of the five major subsamples of students 
with respect to age, sex, vocabulary scores, attitudes toward English 
classes, tester and teacher ratings, were presented. Although the^entire 
group of students was found to be reasonably representative of Intermediate 
Division students and to be quite" comparable across, test-battery groups, 
significant variatioirti in vocabulary and attitude among these groxips 
suggest caution in interpreting grade and test performance differences. 
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Researcl^ Report 74-08 



This report is one ot a series of six which describes in detail 
student attitude? and achievement in major areas of the Intermediate 
English program. ^The six reports,, in turn, represent one major segment 
of the needs assessment phase of an overall evaluation plan which has 
included prior surveys of the community faculty and students and a 
special goals-specification project . 

Because -of the size and complexity of the achievement assessment 
Phase of the evaluation prpject.a 'preface' paper has been prepared which 
gives an overview of the project and describes the sampling procedures, 
subject population, testing strategies, program goals evaluated, etc. 
(Stennetr 6 Isaacs, 1974). The current report has been written on the 
assumption that the reader will have read the, 'preface' paper before 
read'ing this one. 

This report will present, in considerable det^, the students' 
sampled, the attitude and skilT objectives selected f<fr evaluation, 
the tests, scales and ratings used, and the statistical techniques 
employed to describe^summarize and analyze the data. Because it is 
anticipated %iat th/results of this st^idy will be used to formulate 
relatively specific recommendations for changes in curriculum content, 
emphasis and method, detailed, item-level tabulations of student perfor- 
mance on the various tests have been provided in a series ot appendices. 

A major limitation of this and other reports in this series is 
the absence of clearly-stated standards or expectatione of student perfor- 
mance against^which their actual- performance can be evaluated. I« the 
case of some of the standardized tests, norms are available and will be. 
referred to wheif appropriate. In some cases, the judgements .of some 
classroom teachers who participated in the project will be used a$ refer- 
ence points. Hoi«^, really appropriate value judgements about -the • 
adequacy of stuHiSC'performance require the development of explicit, 
detailed, performance standards, Oceyed to student age and ability, diff- 
erences) about- which there is at least a reasonable degree of local con- 



sensus . 



The findings provided in this report, therefore, represent one 
of the important bases necessary for judgements about whether or not the 
current level of skill in reading is '^ladequate". In and of themselves,*, 
they do not allow such judgements. As a source of pertinent information 
for possible curricular changb, howevei , the current findings are among 
the best available. ' . 

10J714 
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METHOD , 

Sampling of Students . - - 

Because of the yesign of this study, different samples of students 
had to be used to assess different aspects of their attitiides and achieve- 
ment in the area pf reading. Most attitude measures and a measure of 
vocabulary skill are available for the entire sample of 2,685 students. 
A test of silent reading skill (Battery II) is available for a sample of 
534 students. Measures of oral reading skill and ability to fellow direc- 
tions are available for a different sample of 540 students (Battery V). 
Measures of English-related research skills are available for another, 
different sample of 546 students CB^ttery I). A more detailed description 
of these samples may be found in tne 'preface' paper (Stennett 5 Isaacs, 
1974). 

These three? subsamples are quite comparable with respect to age, 
and grade and sex composition. Although quite similar with respect to 
verba] ability (mean percentile C.T.B.S.^ vocabulary subtest scores of 
55, 52 and 51 for students receivi.ig Batteries I, II and V respectively)/- 
the students who took Battery I tests are generally more capable. 

Objectives Studied and Jests Used 

In this «ectio^i each attitude and skill 'reading' objective of 
the Jr termediate EngLi'sh program selected for study will be quoted (J^ice 
6 DicJie, 1973) and the tests used to assess it described. 

Attitides 

Objective: To develop in 3tudf>;\ts a deeirc to read for enjoyment. 
Studerts' enjoyment of reacing was measured by a locally-developed six- 
item attitude scale. 



SkilU 

- Objective: To have spudenls acquire a level of vooabulary which 

fulfills their needs. The vocabul.iry Subtest of the Comprehensive Tests 
of Basic Skills (1968 edition), Fojtd Q, was \jsed. This is a 40-item, 
multiple-choice test with one level (3) appropriate for grades 7 and 8 
and. another, more difficult level (4) for grades 9 and 10. 

Objective: To have students acquire the ability ta understand 
literal meaning; to follow a line of reasoning and make valid inferences!' 
, Students were given the STEP Series II Reading Test (1971), which consists 



^Comprehensive Tests of Basic Skills. 
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6i' 60 multiple-choice type items. The. items can be grouped for analysis 
into three types which reflect students^: (a) '*Corfiprehension, the ability 

^ to understand written material..:',- (b) ^Translation and Inferenoe, the 
ability to identirfy ideas when they are s^tated in language different from 
the original presentation; to deduce the meaning of figurative or obscure 
- words^ . . ' , and (c}-'Ar}aly8i8, the ability to recognize and appraise (1) 
literary device^..., and (2) the author's purpose. One; form of the 

test was given to students in grades 7, 8 and 9; a more advanced form to 

. gaf^de 10 Students. 

Objective: To have students acquire research skills including % 
skim reading, uses of takles of contents, indices, headings, dictionary^ 
and library skills, etc. Studient^ were given subtest W-3 Form 11 of the ^ 
.Canadian Tests of Basic Skills (19^8). This subtest contains^ 75 multiple^ . 
choice items designed to measure students' skill in the following seven 
areas: Alphabetizing, Using the Dictionary, Using the Encyclopedia, : 
Using Guide Words, Using the Index, Using Key Words, and Using General 
Reference Materials. One level of the test Was administered to grade^? 
students and a more advanced level to students in grades 8, 9 and 10. 
Althovgh^this test was not designed for high school students, its use 
with'IfRifin in this project as a mastery measure was considered appropriate. ' 

Objective: To have students develop the ability to read orally 
i:'ith expression, rhythm, clarity and proper iniunation. Students were 
given parts of the Gilmore Oral Reading Test (1968) and their response ' 
was tape -recorded. This test consists of a series of paragraphs of 
increasing difficulty which students, tested individually, are simply 
asked to read aloud. The examiner records the time the student takes 
to read each paragraph and counts the occurrences of eight different 
t)T)es of error. In this .study, a different examiner listened to the tape 
of each student's performance and rated it on a simple scale for quality 
of expression. (See Appendix K for the simple scale used to rate Oral - 
Reading Naturalness.), ^ 

Objective: 'To have^ students learn to recognize and be oDare of 
different levels of meaning beyond the literal. Students' success in 
achieving this goal was assessed by using a pre-selected set of items . 
from the STEP II Reading Test described above. , . 

Objective: To develop students* abiHty to folloi: vrittcrr 
instrubtions * Students' mastery of the skill was -assessed by rating the 
extent to which tjiey were able to follow written directions on ^ writing 
assignment. (See Stennett 5 Isaacs, t974.) ' - 

> ~ 

Test Administration 

All tests, except that for oral reading, were administered to 
students in their normal class groups by specially-trained testers 



^With the exception of the Alphabetizing and Reference Material^Use Sub- 
scales, the test items were the ^ame for all students. 
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(Stertnett Isaacs, 1974). During testing the classroom teacher was asked 
to rate both the class and the tests being given on a number of simple, 
locally-produced scales (Appendix A). After each test sessiop, the tester 
completed a simple evaluation foiin (Appendix B) rating the adequacy of the 
testing session. ^ .V 

The Gilmore Oral Reading test was administered individually to 
students in an appropriate location in the student's school. Tlie student's 
performance was timed and tape-recorded^ by the examiner . 

■ % 

Test ScoTvng " 

All 'Standardized tests* were scored, using an NCS Scannei* and IBM 
370 cotaputer, using programs especially written for this purpose. For 
several of the^ tests, subscores were calculated for selected subsets of 
it^s judged to measure specific skills, and counts were made ol" the 
number* of items students answered as well as the number they answered 
correctly. Whenever possible, percentile equivalents for all tctal and 
subscale scores were obtained using the publisher's normative d^ta. 

Certain error tabulations on the Gilmore Oral Reading Test were 
made 'or reviewed vby having two examiners listen to the tapes. lafings 
of the quality of students' expression were made at the same tinie. 

A student's ability to follow writteh directions was estimated by 
simply counting how' many of the required points he observed wher completing 
-his writing assignment^fand then reducing this count to a simple, three- 
point scale (Appendix C) . 

■ ■ ' '\ . 

Data Handling and Analysis ^ 
- ^ ' 0 

AlTof^the data for all of the te^ts were punched into data cards, 
verified and s^ibsequentJy edited by computer. 

^ , All of the 'analyses were done, using standard statistical programs,, 
oh an IBM 370 computer* The major analyses consisted of; - 

(a) calculating descriptive statistics (means and standard devia- 
tions) and preparing frequency and percentage-frequency distributions for 
all variables separately by gr&de; (In some of these calculations, a 



: : 

jThe Committee wishes to thank the Learning Materials Centre for' their gen- 



erous heip in providing the necessary equipment and tapes. 

^Mrs. Pamela Humann's conscientious and dedicated assistance in ^his part 
of the project is gratefully ackhowledged. ^ 

^The Committee wishes to efpje^ss their appreciation to Mr. Wayne Kelly for 
his help with this and all other data processing aspects of this project., 



differentiation was made between students who tried an item and answered 
it Incorrectly and students who failed an item because ti\ey did not 
attempt it.) • * 

(b) calculating one-way analyses of variance (ANOVA) across grade 
and g^ade-sex groups for all ratings, "attitude and skill test SiAscale- » 
and total-scale scores , and' 

(c) intercerreljating all ratings, attitude and skill score.s. 



RESULTS 



ATTITUDE 



Ifnjoyment of Reading ' 

The percent of >^t^ents agreeing and strongly^ agreeing with each 
of the six items malOrf^ up^this scale are provided, separately by igrade 
and sex, in Table 1| The means of tTiese percent 'agreement* figures for 
the six items are plotted in Figure 1. 
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ANOVA tests indicate statistical significance in Wb areas: (1) 
differences between Jjoys and girlS at all grade levels except?, and (?) 
a decrease in the scores of boys ovex the; grade 7 to' 10 interval. These 
findings indicate that girls enjoy reading more than boys' and that boys* 
enjoyment of reading decreases as they progress throifgh the intermediate 
years'. Overall, about 70% of students endorse items which reflect *a real 
enjoyment of reading. ^ . ^ - 



FIGURE 1 Mean of percents of students . agreip ing with 
the six items comprising the Enj^)gnent of 
Reading'scale,' by .grade and sex. 
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TABLE 1 Percent of students, by grade and sex, agreeing* with each item 
in the 'Enjoyment of Reading' scale. 



Item 




Percent 
- Agreeing, 


of ^tudents 
by Grade and 


Sex 


Number 


Item 


Sex • 


7 


8 


9 


10 


1 


I read books apart from those 
that are required reading for 
c lasses , 


F 


83 

t 


82 
91 


88 


72 
89 


6 


I have recommended a book to 
a friend. 


/ M 
, F 


71 
84 


69 
91 


68 
92 


73 
92 


• 16 


Once I have begun a book I 
often finish*it within a few 
days . 


M 
F 


62 
63 


52 
67 


57 
74 


51 

■ 73 


2i 


I have re-read a favourite 
book. 


M 
F 


77 
86 


73 
87- 


65 

72 


56 . 
75 




I enjoy reading novels of 
movies I have enjoyed. 


• M 
F 


76 
80 


68 
86" 


68 
82 


63 . 
83 


29 


When I have extra time in 
class, I often read a / 
library book. 


M 
F 


56 . 
55 


53 
59 


33 
45 


30 
39 



*In order to simplify presentation of the data, the score$ of both 
students who 'agreed' and 'strongly agreed' with an item were added 
together te^ calculate the percent agreement figures presented in 
this table and plotted in Figure 1.' 



SK'ILLS 

Resear^jh skills: Canadian Tests df Basic Skills ^ Subtest W-3 

Although this 'test was not designed for use with high school stu- 
dents, the form normally given to grade 8 students was also given to grade 

9 and 10 students. The percentile equivalents of r^w-sc^es for grade. 8 
students were also used to obtain percentile scores for^the grade 9 and 

10 students. This unusual use of this test is based on the desire to 
provide estimates of student mastery of certain reading subskills rather 
than to compare ^London students' performance against the performance of 
other groups. It is also for this reason that student performance is 
described largely in terms of the percentage of all students passing each 
item on the tests. Equivalent figures for the standardization sample are 
given where available for comparison. The percentage of students passing 
each item is also presented for just those students who actually attempted 
it. 



•Because of their voluminous nature, these data are presented in 
Appendix D. The reader who wishes to make a detailed study or them will 
require a copy of Form 2 of the Canadian Tests of Basic Skills. Simpler 
-summaries of these data are provided in Tables 2 and 3. 



TABLE 2 Mean number of items correct, by sex and grade, for various 'sub- 
scales 'of Form 2 of Subtest W3 of the Canadian Tests of Basic 
• Skills. 





numoG T 

of Items 




Grade 


1 Subscale 


Sex 


7 


8 


9 


10 






M 


11. .8 


2.9 


4.6 


-5.0 


Alphabetizing 


. 16; 12* 


F 


13.4 


4.2^ 


6.3 


7.6 




Total 


12.5 


3.6 


5.3 


6.4 






M 


4.1 


4.7 


6.3 


6.5 


Using the Index 


10 


F 


5.0 


5.4 


6. 5 


7.0 




Total 


4.5 


5. 1 


6.4 


6.8 






M 


2.4 


2.8 


3.4 


3.4 


Using Dictionary Guide Words 


5 


■ F 


3.2 


3.5 


3.5 


3.9' 




Total 


2.9 


3.2 


• 3.4 

9 — 


3.7 






M 


2.2 


2.3 


2.9 


3.2 


Using Key Words 


4 


F 


2.5 


2.7 


2.0 


3.3 




Total 


2.3 


2.5 


2.9 


3.3 






M 


'2.2 


2.7 


2.2 


3.7 


Using the Encyclopedia 


6 


F 


2.6 


2.8 


3.6 


4.0 




Total 


2.4 


2.7 


3:4 


3.9 






M 


3.4 


F 

4.5 


5.4 


6.2. 


Using the Dictionary 


10 


F 


4.1 


5.4 


6.0 


7. 1 




Total 


' 3.7 


5.0 


5.7 


6.7 




1 * 


M 


2.7 


4.1 


5.4 


6.8 


• 

Using General Reference Materials 


8; 12* 


F 


2.9 


5.2 


6.9 


7.3 




Tot^l 


2.8 


4.7 


^6.0 


7. 1 



*For these two scales, the^first number is the number of items for grade 7 
students; the second the nuiii)er of Items for students in grades 8, 9 and 
Iff. In each case, the older students have some different and/or more • 

'^fficult itemsC- ' ^ 

/ ^ 
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^ABLE 3 Mean percentile scores, by grade and sex, for Sub- 
test w|' (Knowledge and Use of Reference Materials) 
of Form 2 of the Canadian feSts of Basic Skills.* 



Sex 


Grade 


7 


8 


9 


10 


Male 


36.0 


25.0 


44.1 


56.^ 


Female 


51.0 


39.4 


58.6 


72.3 


Total 


42.8 


.32.2 


50.4 


64.5 


% of Students 
With Percentile • 
Scores >50 


34.7 


24.4 


47.8 ■ 

1 


68,3 



*Although there are some valid statistical arguments against 
averaging percentile scores, such averages are presented in 
this and other reports' because they do convey, in a fairly 
easily understood way, the pattern of student performance 
by sex. and- grade. A more adequate estimate of the level of 
student performance can be gained by examining the row of 
figures which gives the 'percent of students with percentile 
scores >50*. If London Students performed exactly as well 
as the students in the standardization sample, this row 
, would have a value of 50 entered in each, column. 



ANOVA tests revealed two major trends: girls generally scoi^ 
slightly higher on all of the subscales than boys, and students* scores 
improve gradually over the' grade 7 to 10 interval. London students* 
performance pn these te^ts is generally below that of the national stan- 
dardization sample. 

Teachers* estimates of the instructional- emphasis they had given 
to each of these^skills in their class up to the point of testing are 
summarized in Appendix E; their judgements of the grade at which they 
expect students to have fairly complete mastery of these skills are 
summarized in Appendix F. An examination of these data reveal: (a) a 
very wide variation, both within and across grade levels, in the amount 
of instruction provided in these skills, and (b) a similarly wide varia- 
tion, both within and across grade levels, in teachers* expectations of 
the grade level at which the various skills ought to be mastered. Al- 
though these data were produced by only five teachers at each grade level 



using rather crude scales, it seems quite evident that there is little - 
consensus about when and how much attention ought to be given to the area 
of 'knowledge and use of reference materials'. This may account, in part, 
for students' relatively poor performance on these tests. 

-0 

• * 

Reading Skills: STEP II Reading Test and Vocabulary 

The pcrcents of students passing each item on this test are pre- 
sented, separately for the three 'subscales' of Comprehension, Translation 
and Analysis, in Appendices G, H and I respectively. .The percents passing 
for the normative or standardization sample are also listed for purposes 
of comparison. - 

The means of the number of items correct for each of these same ^ 
three 'subscales' are presented in Table 4 and the mean raw scores with 
percentile equivalents are given in Table 5, all by grade and sex. It 
should be remembered that students in gra<fe 7, 8 and 9 took one level of 
this test (3A) and grade 10 students, a more difficult level (2A). 

Interpretation of these findings is complicated by the fact that, 
whereas the normative data are based upon testing students in the Fall, 
students in this study were tested during February and March. Although 
Spring norms are provided, the test publisher, on direct inquiry recom- 
mended reporting the data in terms of Fall norms. ^ This means that the 
estimates of London students' performance are probably somewhat high. 
It does, however, seejn reasonable to conclude that the London students 
tested did at least as well on .the. rea"ding tests gis students in the norm- 
ative sample. 

One-way ANOVA tests indicate no significant differences in the 
performance of boys and girls on this reading test. Although students 
generally improved their raw scores over the grade 7 to 10 interval, 
their performance, viewed in terms of percentile scores, showed no system- 
atic grade trends. Overall London students' performance on this test was 
as good or better than that of the normative population, U.S. students in 
1968. 

' The pattern of London students' performance on the three subscales 
follows quite closely that of the normative group. There do not appear to 
be any particular weaknesses or strengths related to the skills of compre- 
hension, translation or analysis. 



Personal communication from Dr. J. Goodison, Director, Cooperative Tests 
and Services, Educational Testing Service, Princeton, New Jersey. 



TA^BLE 4 Mean number correct, by grade and sex, for Compre- 
hension, Translation and Analysis 'subscales' of 
the STEP II Reading test. 



Comprehension 



Sex 


Grade 


7 


8 


9 


10 


Male 


14.2 


15.5 


18.5 


18.5 


Female 


13.8 


15.2 


17.6 


18.1 


Total 


14.0 


15.5 


18.0 


18.3 


Test- Level 


3A 


3A 


3A 


2A 


Number of Items 


26 


26 


26 


28 



Translation 



Sex 


Grade 


7 


8 


. 9 


10 


Male 


14.4 


16.1 


19.6 


14.4 


Female 


13.4 


15.5 


17.7 


14.5 


Total 


13.9 


15.8 • * 


18.6 


14.5 


Test Level 


3A 


3A 


3A 


2A 


Number of Items 


28/ 


28 


28 


27 



Analysis 



1 

Sex 


Grade ^* 


7 


8 


9 


10 


Male 


■2.8 


3.2 


3.5 


2.2 


Female 


2.9 


3.2 


3.5 


2.5 


Total 


2.8 


3.2 


3.5. 


2.3 


Test Level 


3A 


3A 


3A 


2A 


Number of Items 


6 


6 


6 


5 



TABLE 5 Mean number of items correct, by grSde and sex, for 
the STEP II Reading Test, with percentile equivalent 
of mean raw score and percent of students receiving 
I a percentile score at or greater than the 50th 

percentile . *' 
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Sex 0 


Grade 


7 


8 


9 


10 


Male 


31.38 


34.74 


41.60 


35. 15 


Female 


3^06 


33.95 


38.72 


35.07 


Total 


30.72 


34.33 


40.04 


35. 10 


Test Level 


3A 


3A 


3A 


2A 


Percentile Equivalent 

of Mean .Raw Score 
e 


63 


53 




56 


% of Students With 
Percentile ScoresiSO 


61.6 


65.3 


63.3 


71.0 



*Based on Fall norms; students tested in February and 
March. 



Reading Skills: Vocabulary 

The mean percentile scores of all 2,685 students on the Vocabulary 
subtest of the Comprehensive Tests of Basic Skills, grouped by grade and 
sex, are given i^i Table 6. These figures indicate that London students' 
word knowledge is as good or better than that of the standardization 
sample on this test. , It is also evident that the performance of elemen- 
tary students is somewhat better than that of the secondary students. 



TABLE 6 Mean percentile score on the Vocabulary 
subtest of the Comprehensive Tests of 
Basic Skills, by grad^e and sex. 



\ 





Grade • 


Sex 


7 


8 


9 


10 


M 


55.6 


55.7 


50.6 


- 50. '8 


F 


50.1 


55.6 


50.5 


48.2 


Total 


52.7 


55.7 


50.5 


49.5 
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Because students' scores on vocabulary tests correlate quite well 
with measures of general intellectual verbal ability, these findings also 
suggest that the sample of students used in the overall evaluation project 
is of at least average ability. This, in turn, tends to eliminate 'low . 
ability' as a factor accounting for less-than-average performance on other 
English skills. 

Ability to Polloix Written Directions 

Stu4ents' ability to follow written directions was assessed by 
rating how well they followed such directions when given a writing assign- 
^^nt. The actual writing assignment is reproduced in Appendix J and the 
^^ating scale In Appendix C. 

The percents of students, by grade, receiving each of three possible 
ratings of the extent to which they followed directions on the letter-writing 
assignment are provided in Table 7. As is evi-dent from the data of this 
table, and confirmed by an ANOVA test, students' performance becomes in- 
creasingly better as one goes up. the grade levels. 



TABLE 7 Percent of students, by grade, receiving 
each of three possible ratings of ability 
to follow written directions on the letter 
writing assignment. 



# Rating 


Grade 


7 


8 


9 


10 


3 


20.4 


23.3 


28.5 


47.3 


2 


53.1 


63.7 


63.8 


48.8 


1 


26.5 


13.0 


6.9 


3.9 



J 



Given the n^tuVe of the task, it is difficult to believe that the* 
relatively poor peTforman««--of^tudents is due to a lack of ability to 
understand and follow directions^ It is much more likely that their 
relatively paor performance result^ from a lack of concern, i.e. , the 
underlying problem is one of motivation rather than one of ability. The 
significance o^ this finding is heightened by the fact that students were 
told that their\performance on this particular assignment could affect 
their term mark. 
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Reading Skills: Oral Reading 

Since it was not possible to administer the Gilmore Oral Reading 
Test in its. entirety, the following procedure was used: all students 
were given paragraph 7; those who made 10 or more errors were then given 
paragraph 5; those who made fewer than 10 errors were given paragraph 9. 
Although this procedure does not permit use of the publishers' norms, it 
does provide a standardized sample of oral .reading behavior and permits 
an analysis of types of error, grade trends and sex differences. 

' Table 8 gives the per^ents of students, by grade, who read either 
(paragraphs 5 and 7 or 7^ and 9. It is apparent from these data that stu- 
-aents' oral reading skill improves considerably over the grade 7 to 10 
interval . 



TABLE 8 Percents of students, by grade, reading either 
paragxaplis 5 and or 7 and 9 on the Gilmore 
Oral Reading Test 



Paragraphs 
Read 


Grade 


7 


8 


9 


10 


5 5 7 


55.5 


40.8 


27.7 


16.7 


7 5 9 


44.5 


59.2 


72.3 


83.3 



ERIC 



Table 9 gives, by grade, the mean number of errors of various types 
made by students as they read paragraph 7 and the mean number of seconds 
they took to read ^t. Again it is evident that students' perfonnance im- 
proves Jiarkedly as a' function of gVcAe level. The improvement i; most 
noticeaDle in the reduction of errois which indicate 'decoding' difficulties, 
i.e., substitutions, mispronunciations and words pronounced by the examiner. 

The percents of students, by grade, receiving various ra:ings ot 
the 'naturalness' of their oral reading are presented in Table 10. Students' 
performance- improves as a function of grade level. The most noticeable 
in5)rovement, probably related in part to the difficulty of the material, 
occurs between grades 7 and 8. 

Interrelationships among ability , 

attitude and reaiing skill measures* ^ 

Because three different groups of students took different batteries 
(I, II and V) of tests to provide an assessment of Intermediate English 



TABLE 9 Mean nuiii>er of errors of various types, by grade, made by 
students when reading paragraph 7 of the Gilmore Oral Read- 
ing Test and mean number of seconds to read paragraph' 7l 



1 

t> 1 




Graule 




Type of Error j 


7 


8 


9 


10 


Substitutions 


5.14 


3.54 


3.18 


2.50 


Mispronunciations 


2.14 


1.13 


.73 


.52 


Words Pronounced by Examijier 


0.48 


. 13 


.14 


. .04 


Disregard of Punctuation 


0.41 


.33 


.17 


.09. 


Insertions 


1.29 


.88 


1.08 


.88 ' 


Hesitations 


0.02 


.03 


.03 ' 


.00 


Repetitions 


3.13 - 


2.71 


2.45 


1.89 


Omissions 


0.85 


-.76 


.67 


- .66 


"Total 


13.49 


9.47 


8.42 


6.59 


Mean Reading Time in Seconds 


77.71 


63.35 


58.24 


51.87 



7 



TABLE 10 Percents of students, by grade, receiving 
various ratings of their 'NaturalTiess of 
Or>l Readi^' on the Gilmore Oral l^eading 
Test. A 



Rating 


Grade 




8 


9 


10 


3 




10.3 


10.3 


12.4 


2 


6t/7 


80.2 


83.6 


85.0 


1 




9.5 


6.0 


2.7 


Mean 


1.84 


2.01 


2.04 


2.10 



V 
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program goals in the area of reading, examination of the interrelations or 
all ability, attitude and reading skill tests is not possible. Those 
relationships which can be examined, therefore, are presented in three 
sets, one for each test battery. 

Also, because students in different grades were given different 
'levels' of the various standardized tests, correlations among. the various 
types of variables could be calculated for. only those students in the 
sample who had taken the same 'level' of the standardized tests. 

(a) Knowledge and Use of Reference Materials 

Pearson product -moment correlations, calculated among vccabulary, 
attitude and subscale scores on subtest W3 of the Canadian Tests of Basic 
Skills, are given in Table 11. An examination of these correlations indi- 
cates that: (i) Students' performance on the various reference subskills 
is significantly but quite modestly intercorrelated. (ii) Students' per- 
formance on all of the reference subskills is related significantly, if 
modestly, to their verbal ability, as measured by the vocabulary test, 
(iii) There is a slight trend for students wh6 enjoy reading and/or tend 
to apply their English skills to have greater mastery of reference sub- 
skills. 



TABLE 11 Intercorrelations among measures of verbal ability, attitude and 

skill in reference material use for 360 grade 8, 9 and 10 stxadents. 



Variable* 


. 2 


3 


4 


5 


6 


7 


■i 


9 


10 


1 . Vocabulary * percentile 


35 




34 


28 


29 


35 


5:; 


45 


27 


2. Enjoyment of reading 




36 1 




16 


20 


16 


20 


20 




3. Application of English skills 




1 




16 


10 




13 






4. Use of the Index 








37 


•34 


40 


43 


56 


33 


5. Use of Guide Words 










36 


25 


36 


26 


32 


6. Use of Key Words 












36 


39 


33 


24 


7. Use of Encyclopedia 














43 


35 


26 


8. Use of Dictionary 
















44 


39 


9. Knowledge of Reference Materials 


















54 


10. 'Alphabetizing 





















♦A correlation of .11 is required for significance ar p <.05; .15 for^"' 
significance at p <.01. Only significant correlations are- reported 
in this table. Decimals have been omitted for ease of reading. 



\ 
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'(}>) Verbal Ability, Attitude and Reading Skill 

Correlations among' vocabulary , attitude and STEP" II Reading Test 
subskills scores, shown in Table 12, reveal the following relationships: 
^i) Student performance on the Comprehension, Translation and Analysis 
reading subsicills arr jnaifir^trtr^nter<;orrelated. (ii) Performance on the 
reading test is highly related (.81) to verbal ability, as measured by the 
vocabulary, test, (iii) There are -significant , though modest, relationships 
between students' rated 'enjoyment of reading' and their reading perfor- 
mance. 



TABLE 12 iBtercorrelations among measures of verbal ability, 
attitude and reading skill for 380 grade 7, 8 and 
9 students . 



Variable* 


2 


3 


4 


5 


6 


1. Vpcabulary Percentile 


33 


71 


'74 


45 


81 


2. Enjoyment of Reading 


1 


29 


28 


24 


37 


3. STEP II Reading - Conq^rehension 






80 


50 


88 


4. STEP II Reading - Translation 








53 


89 


5. STEP II Reading - Analysis 










61 


6. STEP II Reading Percentile 













♦A correlation of .10 is required for significance at p <..05; 
.13 for signific^ce at p <.01. Decimals have been omitted 
for ease of reading. 



(a) Verbal Abilijby, Attitudes and Oral Beading 

Correlations among vocabulary, attitude and oral reading tests, 
shown in Table 13, indicate the following relationshijrs : (i) Oral reading 
performance is moderately related to verbal ability. . (ii) Students who 
enjpy reading tend to do better on the* oral reading test^ (iii) There 
are no significant relationships between students' rated self-confidence 
'in speaking and their performance on the oral reading test. ^ 
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TABLE 13 Intercorrelations among measures of verbal ability, attitude, 
and skill in oral reading for 582 students in grades 7 to 10 
' inclusive . 



Variable* 


2 


5 


4 


5 




1. Vocabulary Percentile 


37 


09 


-43 


-48 


33 


2. Enjoyment of Reading- 






-12 


-23 


26 


s' Self-confidence in Speaking 












4. Oral Reading * T^tal Weighted Errors** 




; 1 




68 ' 


-41." 


S. Ordl Reading -Total Weighted Time** 


M 








-51 


6. Oral Reading Naturalness 













*A correlation of .09 is required for significance at p <.0S; .12 for 
significance at p <.01. Only significant correlations are reported 
in this table. Decimals have been omitted for ease of reading. 

**These two measures involved^ differential weighting of each student's 
errors or reading time^for the Gilmor^Oral Reading test in terms of 
which pair of paragraphs, S and, 7 or 7% and 9, he read. 



SUMMAEY ' ^ 

This report has described the perf(yinance of grade 7 to 10 students 
on sevexal measures of attitude and skill ;felated to explicitly stated 
objectives of the English program in the area of reading. 

Thirteen tables, one figure and eight appendices were used to 
present detailed data concerning students' performance on measures of:, 
enjoyment of reading, vocabulary, sclent reading, knowledge and use of 
reference materials, oral reading, and ability to follow writtrfi directions 

Interrelations among ability, attitude and skill measures were 
noted briefly. 

In general, students' performance in the area of reading shows 
fairly regular growth over the grade 7 to 10 interval witb a tendency 
for girls* performance to be better than that of the boys. Students 
ability and/or willingness to fallow written directions and their know- 
ledge and use of reference materials seem to be somewhat below 'expecta- 
tions.' There is an "evident lack of consensus among faculty concerning 
what skills should be 'mastered' at what grade level, and a corresponding 
wide variability in the teaching emphasis. the skills are given. 
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APPENDIX A ' \ 

I . FOPMS USED BY- THE CLASSROOM TEACHER 

TO RATE HER CLASS AND THE TESTS BEING USED 



IMTERraiATE'ENfiL'lSH PROJECT 



TEACHER RATINGS OF CLASSES AND TESTS 



There are three'major related difficulties in trying tc evaluate 
any program in any subject area: ieciding what program objectives to 
assess; determining how to 'assess them and, finally, locating or devel- 
oping some standards in'terms of w.iich evaluative judgments car be made. 



With the help of various groups of teachers, ,the English study 
committee has selected which elements of the intermediate progiam to 
asses:, first and has selected or developed ^ome tests for tKis purpose. 
The committee, however, is not completely satisfied with all of the . 
tests and needs your help in both evaluating their approprxater ess and 
creat.ng some general st^dards against which th§ adequacy of students 
.perfo.Tnance on them can judged. 

In order to make it* easier for you to communicat^j^ur opinions 
and judgments, the Committee has developed the following set oi questions 
which it would like you to. answer. Some of the questions ask you to rate 
your class in general terms; some are concerned with estimates of your 
class's performance on the tests, and some are concerned with >our 
opinions about the appropriateness of the tests and performance standard^ 
pr gqi^s for them. • ' " 

. Even though some of the questions may seem impossible or very 

difficult, please try to answer all agf them as frankly as you can. 

ax 

BecaUiSe we will want to relate st«dent performance to some of 
the ratings you give, it is necessary to have you identify yourself on- 
the questionnaire form. However, you may rest' assured that you will not 
be identified in any written reports and your responses will, be treated 
as confidential information. The purpose of this project is to evaluate 
program, not people. n 



f 
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NAME: _j SCHOOL; 

If grade 9 or 10, course code (e.g. Eng. 251) 
and title 



Number of different English classes taught this year. 



PART I - RATir. OF THIS CLASS 

Give a general assessment of this class making the following ^ 
ratings. ' " 

Coii?)ared to all of the other classes at this grade level that I 
have ever taught, this class 



is better than average in academic ability 

is of average academic ability 

is below average in aoademic'^i lity 



seem.s to enjoy English more than most classes 
\ shows neither special enjoyment nor distaste for, English ^ 

doesn't seem to enjoy English as much as most classes 

possesses very good English skills ^ 
has average English skills 
is weak in English skills 
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FORMS USED BY TESTERS WrATE THE ADEQUACY OF THE TESTING SESSIONS 



TEST SESSION EVALUATION SHEET 



7 8 9' 10 



Teacher's Name School Grade 

BATTERY .1 II III iv V 

(a) What degree of effort did the students put into doing the testsZ 

I I good, conscienticxis effort ^ 
* ^ . [13 average effort 

rn gave only minimal effort 

r 

' gave sufficiently little effort ^^o 

perhaps invalidate the tests 

(b) To* what degree was the testing .session free of interruptions, e.g., 
M system, someone at the door, unruly student, etc.? 

I I no interruptians at all 

I I only minor interniptions 

I I enough interruptions to interfere 

significantly with testing ^ 

I I serious interruption^ , perhaps 
invalidating the tests 

» 

(c) What was the general attitude of the class toward doing the tests? 

I I very positive 

I 1 slightly positive 

I I ' neither obviously positive or negative . 
I I slightly negative 

r 

^ [m very negative 
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APPENDIX C 

SCALE USED T^) RATE STUDENTS' ABILITY TO FOLLOW WRITTEN DIRflCTIONS 



SCALE 7. 
FOLLOWING DIRECTIONS 

Student has followed directions carefully: 

- written on every other line 

- used letter format 

- included all of pertinent information 
given, e.g. , address 

- responded to specific directions - 
e-g-* giving reasons, explain^^ng the 
situation 



Student has followed directions with respect 
to the main intent of the assignment, but has: 

- failed to write on every other line, or 

- not used letter format, ^or 

- left out pertinent details, e.g. address 



Student has really. not grasped the main intent 
of the assignftent, included pertinent detail 
nor used the a^ppropriate format. 




APPENDIX D 



Percent of students, by grade, passing ea^h item of Subtest W3 of Form 2 
of the Canadian Tests of Basic Skills. ' 



Alphabetizing 



Ite 




Grade 


!ins 


7 - - 


8 


9 


11) 


Gr. 7 


Gr. 8, 
9 5 10 


London 


Norm 




London 




★ 


London 


Norm 


•k 


London 




* 


67 


130 1 80 


71 




44 


01 




56 




76 


67 




80 


68 


131 


84 


80 




37 


%J o 




' 53 




73 


58 




70' 


69 


132 


67 


71 


67 


32 


44 


58 


51 




73 


47 




58 


70 


133 


81 


68 


81 


40 


55 


75 


51 




74 


65 




82 


71 


134 


79 


69 


79 


32 


51 


62 


50 




73 


66 




83 


72 




85 


83 


85 


15 


23 


30 


24 




37 


27 




35 


73 


iJ 


88 


84 


88 


27 


40 


58 


44 




69 


47 




61 


-74 


137 


79 


.75 


79 


31 


54 


66 


48' 




76 


57 




75 


75 


138 


68 


68^ 


68 


26 


47 ' 


57 


45 


—r 


72 


59 




78 


76 


139 


85 


80 


85 


22 


45 


^0 


41 




68 


52 




71 


77 


140 


77 


74 


77* 


23 


45 


52 


■ 37 




63 


49 




69 


78 


141 


88 


77 


89, 


27 


47 


64 


35 




60 


47 




68 


79 




68 


69 


68 




















80 




82. 


77 


82 




















81 




85 


78 


85 




















82 




62 


67 


62 





















♦Percent passing based only on those students who actually tried the 
item. * 

Jhe 'i^ather large discrepancies which occasionally occur between the 
percent passing figures noted in this column and the column headed 
'London' results frcon the fact that a significant number of students 
did fibt finish this timed test. 

It is also important to note that, whereas the alphabetizing items 
were the first ones attempted by grade 7 students, they were the laet 
ones for the grade 8 to 10 students. 
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APPENDIX D (Cont'd) 



the Index 





n . y- 

Grade 




7 


8 


9 , 1 


10 




Items 


London 




* 


London 


Norm 


it 


London 




* 


London 


E 


* 


83 


54 , 


47 


55 


49 


54 


50 


56 




57 


61 




61 


84 


63 


66 


63 


62 


71 


62 


76 




77 


72 




72 


85 


34 


40 


34 


41 


54 


41 


59 




59 


68- 




68 


86 


66 


63 


67 


■ 67 


75 


67 


86 




86 


81 




81 


87 ' 


30 


. 39 


30 


44 


47 


44 


59 




60 


64 




64 


88 


53 


51 ' 


S3 


50 


57 


50 


66 




68 


66 




66 


89 


45 


44 


45 


48 


56 


48 


62 




63 


75 




75 


90 


31 


28 


31 


38 


37 


38 ; 


48 




49 


62 




62 


91 


58 


55 ■ 


59 


64 


61 


64 ' 


77 




79 


75 




75 


92 


24 


48 


25 


44 


55 


44 


52 




53 


59 




59 



93 


64 


57 


65 


71 


70 


71 


73 




74 


80 




80 


94 


49 


45 


50 


58 


56 


59 


65 




66 


71 




71 


95 


34 


43' 


35 


43 


51 


43 


50 




50 


52 




52 


96 


75 


69 


76 


83 


8Q 


84 


86 




86 


88 




■ 88 


97 


51 


60 


52 


64 


66 


64 


71 




71 


79 




79 



#8 


As 


42 


35 


44 


56 


44 


57 




" 58 


71 




71 


99 


74 


70 


76 


79 


81 


79 


89 




90- 


95 




95 


100 ' 


76 


58 


78 


70 


80 


70 


85 ' 




86 


88 




88 


101 


49 


55 


50 


55 


68 


60 


61 




62 


72 




72 
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APPENDIX D (Cont'd) 



Use of the Enaylopedia 



Items 


Grade 


7 


8 


, 9 


10 


London 


Norm 


* 


London 




* 


London 


Norm 




London 




* 


102 


52 


62 


53 


69 


7Z 


69 


83 




84 


89 




89 


103 ' 


40 


25 


- 40 


34 


IB 


34 


45 




47 


42 




43 


104 


59 


55 


60 


58 


62 


59 


68 




69 


73 




73 


105 


4^ 


41 


45 


48 


47 


48 


61 




62 


81 




82 


106 


2S 


41 


26 


39 


60 


40 


58 




59 


73 




75 


107 


18 


20 


19 


26 


28 


26 


22 




22 


26 




27 



Use of 



the Dictionary* 



117 


53 


57 


12 


71 


76 


11 


78 




84 


92 




94 


108 


49 


49 


^.51 


61 


58 


63 


68 




70 


86 




87 


112 


32 


29 


38 


48 


44 


50 


59 




61 


56 




56 


115 


26 


22 


34 


35 


42 


37 


45 




39 


^46 




47 


109 


42 


49 


46 


47 


52 


48 


53 




54 


50 




52 


110 


45 


55 


49 


55 


65 


57 


59 




61 


72 




73 


111 


40 


44 


47 


53 


58 


56 


61 




63 


72 




73 


113 


35 


28 


42 


52 


49 


54 


61 




64 


67 




68 


114 


27 


44 


-36 


44 


52 


47 


53 




56 


71 




72 


116 


22 


27 


30 


31 


42 


33 


39 




41, 


56 




56 



^Double lines in this and the following table have been used to separate 

groups of items which are related to different aspects of the skill in 

question. See Teacher's Manual for the Canadian Tests of Basic Skills, 
Thomas Nelson 5 So^, 1968. 
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APPENDIX D (Cont'd) 



Use of General Reference Materials 















— ' 

Grade 














7 


8 


9 


10 




Items 


London 




it 


London 


Norm 


* 


London 


Norm 


♦ 


London 


Norm 


* 


! 124 


33 


41 


59 


49 


58 


62 


65 




81 


74 




80 


i 125 


21 


14 


38 


35 


44 


46 


50 




63 


63 




68 


i 118 


58 


56 


81 


73' 


74 


82 


86 




^ 93 


92 
— — 




93 


1 121 


23 


21 


37 


37 


34 


44 


48 




55 


57 






: 119 


42 


48 


61 


57 


62 


64 


73 





79 



77 


— i 78 


.. 120 


28 


21 


41 


44 


49 


55 


60 




66 


74 




I 122 


40 


34 


66 


48 


1 ' 


59 


50 




58 


48 


1 -- i ^° 1 


1 127 








15 


20 


21 


29 




-. 

36 


39 


— ■ ! 43 , 


■ 128 








22 


28 


31 


36 




46 


33 


' - 1 3. ' 


1 

129 








32 


44 


48 


42 




56 


57 




66 


123 


35 


43 ■ 


59 


42 


62 


53 


52 




64 


67 






.76 








11 


17 


15 


13 




17 . 


27 




29 



APPENDIX E 
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Teachers' ratings, by grade taught^ of the instructional emphasis they had 
given, up to the poin^ of testing, on the various skills involved in know- 
ledge and use of refeoftice materials. 



Indexing 








f Guide Words 




Grade 






Grade 


Rating* 


7 


8 


9 


10 




Rating*-' 


^ 7 


8 


9 


10 • 


1 




2 


4 


3 


- 


1 


2 


2 


2 


1 


2 


3 


2 




1 




L 


1 


1 


2 




3 


2 


1 


1 


•1 




\ 


1 


1 


1 


1 


4 












A 

H 


. 1 


1 




1 


5 


























rds 




UB€ OJ 


the Encyclopedia 




Grade 






Grade 


Rating* 


7 ! 


8 


9 


10 




Rating* 


7 


8 


9 


10 


1 


1 ■ 


3 


2 ^ 


^ 2 




1 




2 


2 




2 


■ 2 , 




2 




2 


3 


2 




2 


3 


1 


2 


' 1 


1 




X 


1 


1 


2 


1 


4 


1 




1 






A 


1 






1 


c 












c 

' * — ' 












*" the 


• D'lct 




yv7 7 


Use of 
Reference 


Materials 




Grade 




^ n 


Grade 


Rating* 


i 


8 


9 • 


I'D 




Rating*-? 


7 


8 


9 


10 


1 


1 


1 








1 




1 




1 


2 


1 


' 3 


1 


1 




2 


2 


3 


1 


2 


3 


1 


1 


2 


3 




3 


2 


1 


3 




4 


2 




2 


1 




4 


1 






1 


5 






1 > 






5 












'.Iphahetizi 
















Grade 




i - not taught at all 


Rating* 


. 7 


8 


9 


10 




' 2 taught only incidentally^ 


1 


2 


1 


^ 


2 




2 - aiven 


ninor emphasis 




2 


1 


1 

\ 2 


1 

1 1 


1 




4 - taught at fairly regular 






f 

i 1 




1 




intervals 








. 3 - 




2 














4 








1 




j S - Bit^stanttat and aystematzc 
1 errphasi^ 


5 


, 1 


1 
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APPENDIX F 



' judgeJBents, by gVade taught, of the grade level at* which various 
ference material skills should be fairly completely mastered. 




Indexing 



Mastery 
at' 
Grade 


? Grade 


7 


8 


9 


10 


5 










6- 


2 


1 






7 






1 




8 


2 


2 


1 


■ 2 


9 




1 






10 




1 


3 


2 



llBe of Key Words 



Mastery 
at 
Grade 


Grade 


7 


8 


9 


10 


6 


1 








, , • 7- 




1 






8 




2 




9 


i 

1 


2 


1 


10 






2 


11 




1 


1 


Uee of Dictionary 


Mastery 
at 
Grade 


Grade 


1 






10 


5 


1 








6 




• 2 


_____ 




7 


1. 


1 




8 




1 


1 3 


. 2 


9 






1 


2 


10 


1 


■ 1 






11 








1 


12 




1 






13 


1 









Use of Guide Words 



Mastery 
at 
Grade 


; ' Grade 


7 


8 


9 


10 


5 ^ 










6 


3 




1 


1 


7 . 
1 






1 




8' 


2 




2 


2 


^ 9 










10 






1 


1 


Use of Enayalopedia 


Mastery 
at 
Grade 


Grade 


7 


8 


9 


10 


6 


3 


1 


1 




7 




1 


1 • 




8 




1 






9 


1 




1 




10 




2 


2 ; 4 


11 ' " 






1 . 



'General 



use of 



Mastery 
at 
Grade 


Grade 


7 


8 ■ 


9 


10 


6 


1 


1 . 






7 










8 


2 


3 


1 




9 


1 






1 


10 




1 


2 


1 


11 






1 


1 


12 










13 








1 



APPENDIX F (Cont'd) 



Alphabetizing 



Mastery 
at 
Grade 


Grade 


7 


8 


9 


10 


5 




1 






6 


3 








7 


1 


2 






8 


1 


■ 1 






9 






2 


2 


10 




1 


2 


1 


11 










12 










13 








1 
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APPENDIX G 



Percent of students passing 'each of the items making up the Comprehension 'subscale' 
of the STEP II Reading Test. " ■ • / 







FORM 3A 


FORM 2A 






Grade 


Item** 


*■ 


7 




8 


9 




10 




form 


ndon 


* 
* 




ndon 






ndon 


• 




ndon 










o 




it 


o 
.J 




It 


o 






o 




•it 


7 

J 


Z 




81 


90 


92 


87 


92 


99 * 


9S 


99 


90 


91 


on 


A 




7Q 

/ ^ 


66 


81 


O J 


78 


85 


99 


86 ' 


99 


87 


£7 


87 


0 


c 


ft"? 


80 


84 


Q4 


87 


94 


98 


91 


98 


'94 


92 


94 


g 
o 


7 

/ 


AH 


64 


61 


Ol. 


74 


82 


SO 


'83 


90 


88 


86 


85 


1 n 

iU 


0 


/ o 


63 


79 


7R 


71 


79 


83 


75 




94 


88 


94 


1 0 


n 

y 


7 ^ 


72 


"7 C 


RR 


78 


88 


Q4 


83^ 


. 94 


87 


86 


87 




1 1 

1 1 


7Q 


67 


79 


7Q 


74 


80 


90 


82 


90 


78 


76 


79 


1 A 


1 9 
iZ 


CI 

D 1 




52 


^R 

JO 


67 


58 


78 


73 


79 


88 


84 


o o 

88 


^ ft 


1 1 

i J 


JO 


42 


— »— 
39 


J *T 


49 


54 


48 


55 


49 • 


78 


75 


79 




ID 




34 


44 


41 


46 


41 


58 


62 


59 


92 


73^ 


93 




ID 




43 


45 




48 


51 


68 


55 


69 


76 


72 


7.6 


1 


ly 


"^9 

JZ 




33 


"^R 


S4 


39 


50 


45 


51 


67 


59 


^ o 

68 


OA 


90 
ZU 




36> 


35 


40 


44 


.42 


58 


50 


61 


72 


68 


73 


9A 
ZD 


99 
ZZ 


"^9 
JZ 


. 34 


34 


94 

Z*T 


S8 


26 




40 


39 


61 


50 


ol 


» T 1 


97 
Z J 


OD 


77 


86 


RA 

OD 


83 


87 


^•j 


88 


94 


33 


46 


T T 
JJ 






JO 


32' 


38 


47 


S6 


.47 


46 ^ 


45 


46 


27 


27 


28 




71 

oi 


OJ 


54 


66 


79 
/ z . 


64 ' 


73 


R*^ 


73 ' 


84 


67 


66 


'68 




32 ' 


I 31 


24 


32 


31 


2§ 


31 


41 


32 


41 


73 


62 


74 


40 


33 


72 


68 


73 


79 


74. 


80 


90 


82 


90 


94 


89 


94 


.41 


34 


43 


40 


43 


47 


47 


AO 


48 


47 


A Q 


43 


48 


44 


43 


42 


65- 


59 


DO 


65 • 


68 


65 


85 


73 


85 


6& 


C 9 
0/ 


70 


46 


44 


22 


•21 


23 


25 


22 


25 


37 


27 


37 


14 


?o 


14 


48 


45 


35 




36 


'41 


42 


41 


55 


48 


* 55 


^ 57 


50 


' 58 


51 


47 


46 


45 


49 


53 


50 


55 


60 


58 


62 


IS 


23 


18 


54 


49 


53 


54 


59 


54 


64 


60 


68 


69 


74 


48 


37 


50 


59 


50 


29 


29 


40 


38 


S6 


49 


43 


42 


56 


71 


'54 


77 


> 


51 




















42 


36 


47 




55 




















25 


36 


' 35 



*Percent passing based only on those stu4ents who actually tried the item. 

**Item numbers are, of course, different for form 3A and 2A. This test is given 
in two parts with items numbered 1 to 30 in each part. For ease of tabulation, 
^ items in the second part have been re-num^ered 31 to 60. 

ERJC ***Norms are for students tested in the fall term. J 



Percent of students passing e^'ach df the Ltems making up the Translation 'subscale* 
of the STEP II Reading Test. * 



FORM 3A 



FORM 2A 



Grade 



Item** 


7 


8 , 


9 


10 




Form 


London 


* 
* 
* 


* , 


London 




* 


London 




* 


London 




* 


3A 


2A 


1 


"1 


89 


87 


89 


94 


91 


96 


99 


94 


99 


94 


93 


94 


2 


4 


92 


87 . 


92 


96 


93 


^7 1 


98 


95 


98 


89 


84 


89 


5 


.6 


81 


71 ' 


81 ■ 


90 


84 


90 


92 


90 


92 


S4 


80 


86 


7 


10 


82 


70 


83 


^0 


75 


90 


89 


80 


-.89 


?6 


71 


76 


9 


•14 


67 


61 


67 


76 


^6 


77 


79 


73 


79 


88 


■ 78 


89' 


11 


17 


76 


69 


76 


76 


79 


77 


83 


79 


84 


£9 


74 


90 


15 


18 f 62 


49 


' 63 


' 66 


59 


66 


77 


67 


77 


(8 


62 


68 


16 


. 21 


36 


3b' 




47 


48 


48 


77 


. 61 


77 


48 


49 


49 


17 


24 


57 


51 


58 


69 


61 






-^-70 




47 


4S 


47 


19 


25 


48 


39- 


49 


.65 


46 . 


66 


82 


58 


82 


5 1 


40 


52 


r- 

21 


26 


48 


51 


49 


59 


60 


60 


76 


70 


77 


^:•6 


39 


36 


25 


27 


30 


25 


31 


38 " 


30 


40 


51 


40 


53 


:'.6 


32 


37 


27 


28 


24 


18 


27 


24 


22 


27 


42 


31 


44 


47 


33 


49 


28 


29 


21 


20 


25 


30 


28 


33 


40 


40 


42 


'60 


27 


31 


29 


35 


24 


19 


28 


25 


22 


28: 


42 


33 


45 


79 


64 


79 


30 


36 


1» 


21 


22 


29 


27 


33 


37 


'^35 


40 


71 


58 


72 


32 


37 


75 


61 


76 


79 


71 


80 


90 


.^82 


90 




26 


28 


33 


39 


55 


49 


56 


54 


65 


54 


45 


60 


46 


i)S 


86 


66 


36 


40 


40 


35 


66 


42 


41 


43 


53 


49 


54 




55 


65 


44 


46 


72 


60 


74 


76 


70 


78 


a2 


76 


83 


:i9 


35 


40 


45. 


•48 


67 


58 


69 


74 


69 


75 


87 


77 


88 


:;o 


30 


31 ' 


47 


52 


5 3- 


41 


54 


53 


5C 


- 54 


79 


61 


81 


43 


40 


48 


49 


54 


26 


28 


28 


40 


34 


42 


48 


47 


50 


:!3 


20 


28 


50 


56 


30 


31 


.■^2 


33 


39 


34 


44 


45 


45 


:)9 , 


44 


55 


52 


57 


^0 


32 


33 


•42 


38 


46 


44 


49 


47 


39 


41 


67 


5:5 


58 


37 


48 


42 


51 


56 


59 


57 


S2 


65 


25 


24- 


39 


58 


60 


26 


25 


35 


51 


32 


41 


42 


43 


# 

54 


21 




35 ' 


60 


1 26 


24 


36 


28 


30 


36 


46 


40 


60 


-J 







♦Percent passing based only on those students who actually*" tried the item. 

•* . ^ 

**Item numbers are,^ pf course, different for form 3A)and^.^ This test is 'given 
in two parts with items nlunbered 1 to 30 in each P^Jt. For ease of tabulation, 
Y-T%\r^' items in the second part have been re-numbered 31 to 60. 
tRlL 



^NoriDS are for students tested in the fall terni. 
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APPENirX I 



Percent of students^ passin'g each of'the items making ,^isrj^he Analyeiaj^ 'subscale' 
the STEP II Reading Test. ^ ' . . ' ^ 













.. FORM 3A 






» 


1 


^ ■ 

¥0m 2A 










t 






Grade 












. Item** 


7 


'8 


• > 

9 


1^ 


Form 


idon 


* 
* 

* 1 




idon 






c 
o 
•o 
c 






uopu 
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- *rterGent passing based only on those students who actually tried the item. 

•^*It^m num^rs are, of course, different for form 3A and 2A. This test xs given in 
two •parts with items numbered 1 to 30 in each part . For ease of tabulation, items 
^in- the second part have been re-numbered 31 to 60. 
***Norms are for students tested in the fall term. 
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INTERMEDIATE ENGLISH 

.STUDENT WRITING-ASSIGNMENT INSTRUCTIONS 



Write a letter to one of the 'fol],owing three persons. 

The body of the letter should be at least 20 lines. Write on 
.'^very other lihe. Pay careful attention to your grammar, spelling/ 
punctuation, etc. YOu may use a dictionary. Tbis assignment will be 
returned to your teacher, who may use it in determining term marks. 



A TV program which you are lookLng forward to viewing will not be 
shown. In your opinion, t\\e program to be seen in its place is less 
interesting than the originally scheduled show. Write a letter to 
Mr. K. L. Jone^i, at CFEW-TV in tliis city. ^Infcrrm Mr. Jones, ^ho is 
the station manager, of your co)icem by pointing out your reasons 
^for liRing the one program and not liking the other. Be sur3 to 
give convincing arguments in each case. Station CFEW-T.V is located 
at 125 Newmarket Avenue. 

^ ' A. 

You recently bought a certain product. ThMproduct has failed to 
meet its advertised expectations. The locfi^tor^ which sold the 
item refused to help you. Mrs. Ann Smith is the consumer relations 
officer at Ace Manufacturing Limited, the firm'which manufactured 
the procfl,^. Write to her at 419 Southern Avenue^ in Toronto. Out- 
line whatever background information is necessary and the compla'int 
which you have about the^iroduct. Ask for her assistance in finding 
' absolution to the problem. 

You are one of a group of students which wa^^k to have a coke machine 
installed in your school. ^ You have met with the principal and he is 
not opposed to the idea. Before the mSichine can be installed, how- 
ever, petmission must be obtained froih the London Board of Education. 
Write to Mrs. Judy Wliite, wJjo -is Chairman of the Board of Education, 
and explain the situation to her. -Ask her assistance in presenting 
thi^ request toother Board members. Point out the .arguments in 
favour of the 'installation of the machine which she may use in her 
'presentatipn. The mailing address for the .Board ia PjO. Box 5873 
in this city. 
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APPENDIX K 



ORAL READING NATURALNESS 

/ ' 

The student reads loudly* enough 3bd l:he reading is pac^d 
so that it is readily understood. Tliere is correct 
rhythm to the passage with emphasis in the proper pllbes.^ 

? ' 

It is difficult in somf places to understand th)e passage 
because tfle reading is too soft or not well paced. It 
does not always flow" smoothly because of improper emphasis 
or lack of rhythm. 

It is difficult to imderstand the passage because the 
reading is too soft or not well paced. There is" no 
rhythm tO the reading with emphasis either missing or 
inappropriate. 
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R. G. Stennett, Ph.D. 5 Loma Isaacs 
Educational Research Services ' 

Research Report 74-09 

This report is one of a series of six which describes in detail 
s,tudent attitudes and achieveinent in major areas of the Intermediate 
English program. The six reports, in turn, represent one major segment 
of the needs assessment phase of an overall evaluation plan which has 
included prior surveys of the community, faculty and students and a special 
goals-specification project. 

Because of the size and complexity of the achievement ^sessment 
j>hase of the evaluation project, a 'preface' paper has been prepared which 
gives an overview of the project and describes the sampling procedures, 
subject population, testing strategies, program'goals evaluated, etc. 
(Stennett S Isaacs, 1974). The current report has been written on the 
assumption that the reader will have read the 'preface' paper before read- 
ing this one. ^ 

This report will detail the students sampled, the attitudinal and 
achievement goals selected for evaluation, the tests, scales and ratings 
and the statistical techniques employed to describe, summarize and analyze 
the data. • 'Because it is anticipated that the results of this study Will 
be used to formulate specific recommendations for changes in curricular 
content and method, detailed item-level tabulations of student' perfcrrmance 
on the various tests have been provided in a series of appendices. 

A major limitation of the current report is the absence of clearly- 
stated standards or expectations of student performance against which their 
actual performance can be evaluated. In the case of sc^e of the standard- 
ized tests, norms are availabde and will be referred to' when appropriate. 
In other cases, for example spelling, students' performaince can be assessed 
against an absolute standard. For some tests, classroom teachers made, 
judgements about the appropriateness of the tests ^d, in a general wayi, 
indicated how they thought students should and would perform. However, 
really appropriate value judgements about the adequacy of student ^rfor- 
mance require the development of explicit, det.ailed, performance s^dafds, 
(keyed to student age and ability differences) about which there is at 
least a reasonable degree of local consensus. 

The findings pi;ovided in this report, therefore, represent one 
of the important bases necessary for * judgements about whether or not the 
current level of student skill in writing is "adequate". In and of them- 
selves, they doi not' allow such judgements. a source of pertinent 
information for possible curricular chance, however, the current findings 
are undoubtedly the best available. 



METHOD 



Sampling' of Students 

Because of the design of this study, different samples of students 
had to be used to assess different aspects of their attitudes and achieve- 
ment in ^he area of writing. Most attitude measures are available for the. 
entire sample of 2,685 Students. The tests, which required students tb 
write a business letter (Battery V), involved a subsain)le of 540 cases. 
A different subsample of 537 students took the writing-related subtests of 
the Comprehensive Tests of Basic Skills (CTBS) (Battely IV-). A more detail- 
ed description of these saii?)les is provided in the 'preface* paper (Stennett 
5 Isaacs, 1974). 

The Battery IV and V ^ubsamples are quite comparable with respect 
to age, and grade and sex composition. Although quite similar with res- 
pect to verbal ability (mean percentile CTBS vocabulary subtest scores of 
49 and 51 respectively), the grade 9 an<J 10 students who took Battery IV 
indicated significantly more 'enjoyment of English classes* than those who 
took Battery V. • 

Objectivee Studied and Teste Used 

In this section each attitudinal and skill 'Writing' objective of 
the Intermediate English program selected for sturdy will be quoted (Rice 
§ Dickie, 1%73) and the tests used to assess it described. 

Attitudinal Objectives 

Objective: To develop in students an enjoyment of vriting. Stu- 
dents.' enjoyment of writing was assessed using a simple, locally-developed 
attitude scale consisting of three Likert-type items. 

Objective: To develop in students an acceptance of and preference 
for the conventions gf usage, spelling, sentence etrudture, punctuation, 
paragraphing and essay writing, but an ability to violate these conventions 
appropriately. Students' attitudes toward conventional correct egression 
were assessed directly using two locally-developed attitude scales. One 
scal.e, called 'Usefulness of Grammar"* , contained 5 Likert-typfe items; ^he 
other 'Application of English Skills', contained 4 such items. An indirect, 
but perhaps equally valid, indication of students' attitudes toward correct- 
ness in written expression can be derived from an evaluation o^ the sample 
of their writing behaviour taken to assess their skill. 

Skill Objectives ♦ 

Objective: To have students d^elop skill in writing exposition, 
narrative, -description and argument, 
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Objective: To have students develop precision in written, language; 
to make calculated choices among words and word groups; to differentiate 
shades of meaning among alternative expressions; to be able to use standard 
reference books of English usage* 

Objective: To have students be able to use the conventions of usage, 
spelling, sentence structure, punctuation, paragraphing and essay writing 
zn an appropriate manner. 

Students' attainment of these objectives was assessed primarily by 
having them write a business letter {^pendix A). This assignment, done 
during a regular class period under the supervision of a tester, was pre- 
sented to students as possibly contributing to their term mark in English. 
They were asked to have at least 20 lines in the body of the letter and 
were given 3^/ninutes to complete it. They were allowed free access to a 
dictionary. ^ 

Students were provided with descriptions of three different situa- 
tions and could write a letter appropriate for any one they wished. Each 
of the descriptions contained all of the information necessary for them to 
-use proper names, titles, addresses etc. 

Students' productions were corrected for format, spelling and 
grammatical errors by two experienced English teachers^ using a specially- 
prepared marking scheme and tabulation sheet^ (Appendices BSC). Each 
student's production was also rated on 8 simple scales: presence of, and 
support for, a central theme; organization; sentence structure; clarity 
and effectiveness of communication; imagination, freshness, vitality, 
richness; handwriting; following directions; and appropriate use of 
letter format (Appendix D). 

In addition to the writing assignment, students were given three 
subtests of the Comprehensive Tests of Basic Skills (1968), Form Q, ftevel 
3 for grades 7 and 8; Levef*4 for grades 9 and 10), to assess their know- 
ledge of: punctuation and capitalization (25 items); correct expression 
(30 items), and spelling (30 items). All 85 items are of the typical 
multiple-choice type. Because of time constraints, only 20 of the 30 
items measuring correctness of expression ^ere administered\ 

9 

Test Administration 

All tests were administered to students in their normal class groups 
by specially-trained testers (Stennett & Isaacs, 1974). During testing the 
classroom teacher was asked to rate both ,the class and the tests being given 
on a number of simple, locally-produced scaled (Appendix E). After each 
test session, the tester completed a simple evaluation form (Appendix F) 
rating the adequacy of the testing session. 



The Committee wishes to acknowledge the dedicated and conscientious assis- 
tance of Mr. Terry Benbow and Mrs. Marylou Cunningham in this aspect of 
the project. 
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Test Scoring 

The subtests of the Con^rehensive Tests ol^Basic Skills were scored* 
by computer. The writing assignment was hand scored as described above. 

As part of the preliminary training of the two test scorers and as 
part of the process of monitoring the reliability of their ratings and 
marking', a sample of 28 student letters were 'marked' by both scorers. 
The results of the two scorings were correlated and percent of agreement 
figures calculated for all of the ratings made and types of errors counted. 
Inter-rater correlations for the 8 rating-scales ranged from .78 to 1.00 
with a median of .85. With 'agreement' defined as being 'within one point 
of one another' , the percent of agreement figures for the 26 types of error 
tabulated varied from 67 to 100 with a median of 100. These figures indi- 
cate a satisfactory degree of rater reliability for purposes of this study. 



Data Handling and Analysis 

All of the data for all of the tests were punched into data cards, 
verified and subsequently edited by computer. 

All of the analyses were done, using standard statistical programs, 
on an IBM 370 computer. The major analyses consisted of: 

(la) calculating descriptive statistics (means and standard devia- 
tions) and preparing frequency and percentage- frequency distributions for 
all variables separately for grade and grade-sex groupings of students; 
(In some of these calculations, a differentiation was made between students 
who tried an item and answered it incorrectly and students who failed ah 
item because they did not attempt it.) ^ 

(b) calculating one-way analyses of variance (?SB¥A) across grade 
and grade-sex groups for all writing-test errors and ratings, attitude 
and skij^l test subscale- and total-scale scores; 

(c) ir>tercorrelating writing-test errors and ratings and factSr- 
analyzing the resulting matrix, and 

(d) intercorrelating the main subscores from all attitude and skill 
measures. '^^^^ ^ 

RESULTS 
ATTITUDE 

Enjoyment of Writing. The percent of students agree*ing and strongly 
agreeing with each of the three items ifiaking up this scale are provided, 
separately by grade and sex, in Table 1. The means of these .percent 'agree- 
ment' figures for the 3 items are plotted in Figur.e 1. 




TABLE 1 Percent of students, by grade and sex, agreeing* with each item 
in the 'Enjoyment of Writing' scale. 







Percent 


of Students 




• 

Item 




Agreeing, 


by Grade and 


Sex 


Number 


Item 


Sex 


7 


8 


9 


10 






M 


64 


54 


44 


36 


3 


Memory work is worthwhile. 


F 


64 


60 


49 


42 




I enjoy writing short stories. 


M 


73 


62 


60 


43 


8 


F 


69 


75 


60 


56 






M 


45 


41 


27 


23 


18 


I like writing poetry. 


F 


65 


58 


49 


53 



*In order to simplify presentation of the data, the scores of both stu- 
dents who '.strongly agreed' and 'agreed* with an itea were added to- 
gether to calculate the percent agreement figures presented in this and 
Tables 2 and 3, and plotted in Figures 1, 2 and 3. 

r 



FIGURE 1 Mean of percents of students •agree- 
ing with the three items con5)rising 
the Enjoyment of Writing scale, by 
grade and sex. 
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ANOV^A tests indicate that, both the differences between' boys and 
girls are significant at all grade levels except 7 aifd aiso that the 
decreases in the scores of both boys and girls over the grade 7 to 10 
interval are significant. These findings indicate that boys enjoy writing 
less than girls atd that all stiKients' enjoyment in this activity decreases 
rathei" draaaticaliy. as they progress over the grades. Boys' enjoyment of 
writing decreases more rapidly tha^/that.of the girls. 

Usefulness of Grarmar. The percents of students agreeing with . 
each .of the five items making up this scale are provided, separately by, 
grade and sex, in Table 2. The means of these percent 'agreement* figures 
for the five items are plotted in Figure 2. > 

TABLE 2 Percent of students, by grade and sex, agreeing with the five items 
making up the Usefulness of Grammar scale. 



Item 
Number 


Item 


Percent of Students 
Agreeing, by Grade and Sex 


Sex 


7 


8 


9 


10 


2 


The study of grammar helps my 
writing. 


M 

F 


55 
55 


51 
69 


68 
80 


68 
82 


12 


The gransnar I study is 
-necessary. 


M 

F 


87 
83 


74 
83 


71 
78 


63 
76 


14 


I believe that people who 
use poor gtammar are poorly 
educated.'" 


M 
F 


37 
37 


32 

' 33 


32 
33 


22 
30 


, 22 


Punctuation rules are good to 
know. 


M 

F 


89 
92 


89 
93 


88 
91 


82 

90 


30 


I try to apply the grammar 
rules that I have learned 
when I am writing. 


M 
F 

is 


81 
85 


73 
86 


79 
85 


75 
81 



ANOVA tests indicate that: at all grade levels except 7, boys 
agree with these items less often than girls; there is a slight trend- 
for secondary boys to agree less with the items than elementary -boys . 

Despite these differences the overall number of students agreeing 
with the items making up this scale is quite high... about 70%. An inspec- 
tion of student response to the individual items making up the scale 



ill , 



suggests an increasing endorsation of the concept that granroar* study h^lps 
their writing with decreasing, though substantial, agreement that the study 
of granmar is necessary. 



FIGURE 2 Mean of percents of students agree- 
ing with the five items comprising the 
Usefulness -©f Grammar scale, by grade 
and sex. 




Application of English Skills. The percents of students agreeing 
with each of the four items of this scale are provided, separately by grade ^ 
and sex, in Table 3. The corresponding means of percent of agre^ent 
across items are plotted in Figure 3. 

ANOVA tests indicate a substantial difference on this scale between 
.boys and girls at all grade levels. In addition, there is a significant 
decrease in boys' agreement with these items over the grade 7 to 10 
interval. 

Although the majority of students apparently do apply their English 
skills when they write, a substantial minority do not. This finding is 
particularly important when considering student performance on the writing 
assignment. It may be that, at least some of the students' errors on this 
task can be attributed to a lack of concern about correctness rather than 
a lack of ability or knowledge. For example, even though dictionaries 
wer^ available to students during the writing assignment, the testers 
reported that very few students actually used them. The superiority of 
girls' writing performance may also be rela:ted to their greater degree of 
concern about correctness. Compare, for example, the girls' and boys' 
responses to items 17 and 26. 



TABLE 3 Percent of students, by grade and sex, agreeing with each item in 
the 'Application of English Skills' scale. ^ 



Item 
Number 




Percent 
Agreeing , 1 


of Students 
by Grade and Sex 


Item 


Sex 


7 


8 


9 


10 


c 


1 iooK up uniamiiiar woxud hi 
a dictionary when I come 
across them in a book. 


M 

n 
r 


• 

56 


' 56 

0'* 


51 


A A 

44 


10 


When I write notes to a friend, 
I use complete sentences. 


M 

F 


57 
59 


45 

57 " 


47 
54 


37 ' ' 
51 


17 


Before I hand in a social 
studies or science report, I 
check the spelling of words 
which J think- I may have 
spelled incorrectly. 


M 

F 


66 
74' 


58 

75 


57 
78 


57 
75 


26 


I usually check whatever I 










54 




write to make sure that there ^ 


M 


62 


56 


55 




are no mistakes in spelling, 


F 


73 


80 


78 


80 




grammar or punctuation. 













FIGURE 3 Mean percents of students agreeing with 
the four items comprising the Applica- 
tion of English Skills scale, by grade 
and sex. 
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In general, girls attitudes toward writing, as indicated on all 
three scales, are more positive than boys' attitudes. In addition,- while 
boys' attitudes tend to become less 'positive over the grade 7 to 10 inter- 
val-on all three scales, gi^ls demonstrate this trend only for Enjoyment 
of Writing. 

SKILLS 

Writing assignment. In order to -describe in detlail students' 
performance on the writing assignment, an explanation of how the data 
were- tabulated for analysis is necessary. 

For each student's production the following counts were made:* 
number of words written, number of sentences written and' number of 'lines'^ 
written io cover, the non-body or 'format' portions of the letter. (See 
Appendix B.) **Counts were also made of the frequency with which each of 
26 different t>Tpes of errors were made . (Appendix B) . These errors wer^* 
judged to^be of three major types: sentence errors (16), word errors (9), 
*d 'format errors (1). Totals of the number of errors of each of these 
three t^^^n^^Twrere calculated. 

A Because students wrote differing numbers of sentences it was also 
necessary, in order to make comparisons among groups of students, to 
calculate the number of errors of various types they made as percentages 
of tiie ipumber of words, sentences or format lines they wrote. Sentence' 
efrors were taken as a percentage of the number of sentences written; 
word errors as a percentage of the number of words written, and format 
rerrops as a percentage of the number o^format lines written. Total 
errors for the production were calculated both as a percent of number 
of words^^and number of sentences written. 

Table *4 provides mean values for several overall statistics which 
describe student performance on the writing assignment, separately by 
grade and sex. A description of the number and percent of each of 26 
errors made is provided in Appendices G and 

An examination of Table 4 indicates that girls tended to write 
more' wcr<fs and sentences and have more complete formats for their letters 
than* did the boys. Girls' tendency to write shorter sentences than boys 
probably rep^resents their use of better sentence structure. Overall, 
students wrote about 7 or 8 sentences and used approximately 135*-words. 

In general, students made about one word error for every 20 words 
they wrote, and 1 to 2 sentence errors in every sentence they wrate. 
Girls generally made fewer errors than boys and the number of errors de- 
creases quite dramatically over the grade 7 to 10 interval. The general 
level of err6rs, however, seems quite high. For example, even ^t the 
grade 10 l^vel, the average rate of sentence-type errors is one*i)er 
sentence. 
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TABLe 4 Mean values, by grade and sex, for several variables which describe 
student performance on the letter writing assignment. 







0 Grade 


Variable | 


. Sex 


7 ' 


8 


9 


10 


tlUillUC X vX WUXUd WXXLLdl* v 


M 

F 


117 
123* 


129 
140 


128 
148 . 


131 
14S 


ViimKpT* n'f ^pnt'Pnpp^ WTi t't'Pn 

J^LUllL/CX UX SCllLdl^CO ffX^UUC'ii* 


M 

F 


6.8 

8.0 

■' 1 


7.4 
7.8 


6.5 
8.4 


6.9- 
8.5 


oentence icn^^tii* 


M 

F 


17.4 
.16.1 


19.0 
18.3 • 


21.8 
18.0 


19.0 ' 
17.4 


IiUluUcx ux xuxiuaL xxiicdi 


M 

F 


5.0 
5.8 


6.1 

%o 


6.2 
6.4 


6.6 
7.3 


IlUiUUcX Ux WU XU cXXU^s. 


M 

F 


8.4 
6.1 


7.7 
, 5,. 5 


6.9 
5.8 


6.3 
4.6 


rcxCcIlL UX WUXU ClXUx^* 


"F 


7^5 
5.5 


6.2 
4.1 


6.1 
5.0 ■ 


\ 5.3 
3.5 


Number of sentence errors. 


M 
r 


. 8.7 


9.8 
8.4 


" S.Oy 


7.9 
7,0 


Percent of sentence errors.* 


M 

F 


149.7 
118.2 


153.8 

117.1. 


1/7.1 
/l4,2 


12^.9 
87.8- 


Total .tiumber of errors. 


M 

F 


21.9 ; 

18.3., 


22.8- 


48.8 
19.3 


17.6 
14. r. 


Total errors as percent 
of words written. . . 


M 

' F 


20.8 
16.0 


18.6 
L3.9 


16,0 
16.3 


15.2 
10.4 


Number of cases in sample. 


M 

F 

• 


58 

69. 


.73 
54 


. 78 
67 


62 

53 • 

1» 



♦Percentages in excess of 100 result from the fact that the number of ^ 
sentence- type "errors made by students was. greater than the number of 
sentence? they wrote. ^ " 



' The percentages of students receiving each rating on each of the 
flight scales used to evaluate' their letter-writing assignment are given 
in Table 5, separately by grade'. 
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•TABLE 5 Percentages af ^tifdents', by grade, receiving each rating on .each 
• of the' 8 scales used to evaluate their, letter-writing assignment. 



''See Appendix D 
a ratyng of 3 is 



for 



^ Sc 


ale* * j 




Grade 


Rating' , 


. 7 


8 




16 


Presence of, and 5 
^central theme. 


upport^for., a 


3 

, , 2 
.1 


29 • 
50 

. 22 


28 
60 
12 


38 
54 
8 


■47 
49 
5 


Organization of tl 


• 

le theme. * ^ 


3 »' . 

^' 1 
1 


.l' 
67 
32 


4-. 
77 - 
19 


5 

80 " 

14 , 


13 
79 
8 


Sentence structure 




3 

' 1 


3 
65 
31 

• 


5 
69 
27 


6 
75 

19, 


H 

82 

9 




^Clarity and effeci 
communication. 


:iVene$s of 


3 
2 
1 


3 
80 
16 


1 

84. 
14 


" 6 
85 
8 


■ 7 • 
'87 
6 


' ; 

Imagiiwition, fresiiness, vitality, 
richii^s . r ^1 


2 
1 


11 

29 
m 


12 

DO 

22 
> 


• 21 
15 


23 

D 1 

16 


HaTij^lwritihg. 




3 • 

-2 
1 


18 
79 
• 3 


19 
77 
3 


15 
79 
5 


26, 
72 ' 
2 


Pollowixjg directi< 


ms. 


3 
2 
1 


-•go 

53 
27 


23 
64 
13 


29 
■ 64 

i 


'47 
49 - 
4 


JUse Of 1^?^ 


[|iat. . • 


. 5 
4 > 
3. 
2 
1 


1 1 

35 
12 


■sjlj 

1 34 

30 

• 12 


r - 2 
15 

■■ 25 
10 


2 
31 
45 

19 , 
2 

i 



a detailed description of these scales. In ge,n€ral, 
excellent'*, 2 'average' and 1 'poor'. *" j 



i 
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\ One-yay ANQVA test? indicate that, with the exception of 'Harid- 
wriricgS students; scores on all of these scales improve over the ^rade 
7 to 10 interval. Sincere raters did not adjust their standards as\a 
function of the.studertts* grade revel, thi improvement of ratings implies 
a real improvement in the quality Qf the letters writter 



Ltten. 
ilrore 



In order to give the reader a more concrete il^pression of the 
quality of letters produced by the Students, five act^ual student letters 
are reproduced, unedited, in Appendix I. These letters were selec'ted, in 
term^ of the sum of student's scores^on the « fating scales, to represent 
performances at the 10th, 25th, 50th, "VS^ and 90th percentiles. That is, 
the fitst letter is one for which the totarl score on the eight scale? was 
as good as or better than the score of about ten^-percent of >all letters; 
the second letter's totals score 'was as good as or bett_er than the score 
of about 25 percent of'all letters, ej^. • ^ 

Table 6 giVes' the percent of'student letters, by grade, falling 
into ^three large percentile groups in terms of their total score on all 
eight ra^ng. scaled ► It is quite apparent from these data that the over- 
all quality of students' letters improves considerably over the grade 7 
to 10 interval. A fairly good impression of the ^^tudents ' overall perfor- 
mance can be obtained by reviewing . the data of ^is table in conjunction 
with the five sample letter^ provided in Appendix I^. 



TABLE 6 Percent of studenC letters, by grade, 
fallirrg^inta three large percentile 
groups rn terms of their total score 
on all* eight' rating scales. 



X 



Grade 


r ~V ' 

Percentile Groups ■. 


^ 0-25 , 


26-75 


76-100 


7 1 


32 . 


49 • 


19 


8 


«• 

19 


. S4\ 


— ^ 


9 


15 


63 


22 


10 


f 6 


41 


■^3 



' In an attempt to discover whether or not the 8 ratitigs^^d \M 
error tabulatipns might represeng^^ fewer number of underlying &imension$, 
the scores of all 552 students were intercbrrelat^d and the resulting, matrix 
, factor analyzed. The.a-otated factor matrix, consisting of only, two factors, 
did not reveal a meaningful pattern of loadings and, therefore, this line 
of analysis was not pursued ^further. . ' * • 



CompreheiXive Test ^ Basic Skills 



'Interpretation of students' performance on this test is made 
difficult by four factors: (a) the norms for .the test are based on the 
performance of American students in 1968 (b) since all of the 'items were 
not administer-ed, some of the percentile norms cannot be used| (c) the 
test is norm-refereiKecfand we are attempting to use it- as a criterion- ^ 
referenced te^, and (d) a different 'level; of the test (containing 
different items of differing' levels of difficulty) is used with grade 7 
and 8 studdits than is used with grade 9 and 10 students. 

For these reasons student performance is described largely in 
terms of the perfentage of all students passing each item. Equivalent 
figures for the standardization sample are provided for comparison. 
Because of our'concem with mastery, the percentage of students passings 
each item is also presented ^g ^jub l" ll t o ^^-yttlden t s who a^^ally attempted 
it. Because of their voluminousn^tts:^.4r|y^ data are presented in 
Appendix J. The reader who wishes 'to. inS'S'">'4eta^ studyf of them will 
require a copy of the Form Q, Level 3 an4 LevelT^t wt book t tr c^. Simpler 
summaries of these data are provided below in Tables 7 to 10. 

It is quite apparent from the data contained in these four tables 
and in Appendix J, that the London students ' ♦performance is generally 
slightly poorer than students in the normative sample. It is, however, 
aljso *true that this particular sample o^ London students contains a 
slightly higher percentage of boys and' has less verbal intellectual 
ability than thk other samples who received different tester (See 
Stennett & Isaacs, 1974}^. _ It is difficult, therefore ,jto generalize _ 
from the performance of the current sample to all London students. 

In general, London students' skills in punctuation and capitali- 
zation are less adequate than their skill in spelling. One-way ANOVA 
tests indicate that*, with. minor exceptions, girls do better than boys on 
^IL tests at all grade leA^els. In addition, as one might anticipate, 
students' ^solute level of skill generally improves as they go up the 
grades. ' . ^ ^ . 



^2 



A concerted effort to develpp a workable formula in terms of- which 
student?' total scores could be reliably estimated on ythe basis of the 
items they did do failed. Jhe basic reason for this failure was'that 
students' scores are influenced by the, number of items th&y attempt and 
no method could be developed which di5 not either systematic^&lly over- 
or under-estimate^ the scores^ of students who did not try all the items. 



TABLE 7 Mean number of items correct , by grade and sex, for Sub- 
test 3 of the Comprehensive Jests of Basic Skills, Form 



Q. 


Levels 3 and 


4. 








* 

Subtest^; 


Items 1-23; 


Punctuation 






Level 3 


Level 4 


Group 


" Grade 7 


. Grade S** 


Grade 9 


Grade 10 


Male 


— 


9.1 


8.3 


9.0 


Female 


9.6 » 


10.1. 


9.1 .. 


10.0 


Total 


'9.1- 


^ 9.5 


8.7 


9.4 




Subtest 2: 


Items 24-25; 


• 

• Capitalization 




Level 5 


Level 4 


. Group 


Grade 7 


Grade 8 


Grade 9 


Grade 10 


Male 


4.6 


5.6 


5.8 


6.8 


Female 


6.3 


: — ■ — 

7.3 


6.4 


^^=y — 


- Total 


5.6 


6.3 


6.1 


7.4 



Subtest 3; Items 1-25; Punotuation and Capitalization 



Group 


Level 3 


• Level 4 


Grade 7 


Grade 8 


Grade 9 


Grade 10 


Male 


13.2 


14.6 


14. 1 


15.9 


Female 


15.9 


17,.'4 


15.4 


18.0 


- Total 


^14.7 


15. -8 


14.7 


16.8 


Norm' 


' 16.1 


17.3 


15.9 
' 7 


17.0 



TABLE 8 Meanvnumber of items correct, by grade and sex, for Sub- 
"t^st 4 of the Comprehensive Tests of Basic Skills, Form 



Q, Levels 3 and 4.- ' ^ 

>v Subtest 4; Items 26-45; Usage ' C 


Group 


Level 3 


9 

Level 4 


Grade 7 


GraSe 8' 


Grade 9 


Grade lo' _ 


^Male 


13. r 


13.5 


13.0 


- 14.1 


Female 


13.0 


14.6 < 


14.0. . 


14.7 


Total 


' 13.1' 


13,. 9 ' • 


13.5 


14.4 



4 \ 



TABLE 9, Mean number of items correct, by grade 'and sex, for Sub- 
V * test 5 of the Comprehensive Tests of Basic Skills, Form ^ 

Q, Levels 3 and 4. ' 



Subtest 5; Items 1-20;, .Spelling 



Group 


Level 3 


" Level 4 


Grade 7 


Grade 8 


Grade 9 


Grade 10 


hfale 


16.2 . 


. 19.3 


16.0 


17.8 


Female 


19.0 


21.9 


19.7 


19.8 


Total 


17.7 ^ 


20.4 


17.7 


18.8 


Norm 


18.9 


20.6 


18.0 


19.7 



^ • . • . • n -' . 

TABLE 10 Mean percentile scores for Subtests 3 and 5 of the Comprehensive 
Tests of Basic Skills, Form Q, Levels 3 and 4. 



Subtest Z: Punctuation and Capitalization 



Group 


Level 3 


Level 4 


Grade 7 


Grade 8 


Grade 9 


' Grade 10 


Male 


• 34.7 


34.4 


40'. 7 


41.3 


Female 


48.5 


50.1 


47.4 


55.6 


Total 


42.2 


41.1 


4.3.8 


47.9 


Norm 


50.0 - 


50.0 




50.0 


% Students With 
Percent >le 
Scores >50 


38.5 


37.1 


40.0 


50.5 



Subtest 5: Spelling 



Group 


Level 3- 


Level 4 


Grade 7 


"Grade 8 


Grade 9 


Grade 10 


Male 


39.3 


44.5 


42.7 


41.3 


Female 


51.8 . 


56.7 


58.9 


' 51.2 


Total 


46.1 


49.7 


5b. 2 


45.9 


. Norm 


50.0 


50.0 


50.0 


50.0 


% Students With 
Percentile 
Scores >50 


39.2 


49.6 

I 


49.6 


* • 

41.7.. 
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« ATTITUDE AND SKILL INTERRELATIONSHIPS 

^ Because different samples of students took different combinations 
of tests related to the assessment of writing skills, an examination/ of 
the interrelationships among attitude and writing skill measures is of 
necessity incomplete. In addition, because, grade 7 and 8 students took 
a different level of the Comprehensive Tests of Basic Skills than grade 
9 and 10 students, relationships among subscale scores on this test and 
attitude measures could only be studied using about one half of the 
original battery IV sanple. 

7 

Attitudes and Skill in Punctuation^ 

Capitalization, Usage and Spelling ' ^ 

Correlation coefficients calculated among the relevant attitudinal 
* and skill variables are given in Table 11, along with their correlations 
with students' scores on the Vocabulary test, a presumed measure of verbal 
ability. • ' ' . ^ 



TABLE 11 Intercorrelation of verbal ability, attitude and writing skill 
* variables for 240 grade 7 and 8 students. 



Variable* 


2 


3 


4 


"5 


6 7 


8 


9 




1. Vocabulary Percentile 


38 




19 






44 


25 




52 


2. Enjoyment of Reading 




19 


27 


14 


36 1 


31 


28 


35 


"40 


3. Enjoyment of English Clashes 






51' 


28- 


39 1 








18 


4. Usefulness of Grammar 








23. 


-53 ! 




2d 


15 


22 


5. Enjoynsent of Wxiting 










30 1 










6. Application of English Skills 














14 




16 


% . ' J 

7. Punctuation 














31 


47 


42 


8/ Capitalization 
















25 


39 


9. Usage 


















48 


IQ. Spelling 





















*A correlation of .14 is required for statistical .significance at ' ' 

p <.05; .18 for significance at p <.01. Non-signif ican.t correla-'^' > 
tions are not reported in this table. Decimals have been omitted ' ^ 
for ease of reading.' 
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The following relationships are evident from the data provided in 
this table: 

(a) Students* scores on the 5 attitude scales are significantly, 
though quite modestly, interrelated. This suggests- that, to a very limited 
-degree, a student who is positive in any of his English-related attitudes 

tends to beipositive in all the others. 

(b) Students* scores on the tests measuring skill in punctuation* 
capitalization, usage and spelling are significsmtly , if modestly^, inter- 
related. The size of the correlations (.25 to .48) indicates that these . 
are relatively independent skills even though, to a limited degree, a * 
student who is proficient in one will tend to be proficient in the others. 

(c) AlthQugh students* scores on the vocabulary test correlate 
moderately with their scores on Xh^ skill tests (.25 to .70)^ their 
vocabulary scores correlate significantly with their scores on only two 
of the five attitude scales. It is apparent that students' performance 
on the test of Usage depends fairly heavily on verbal ability. 

(d) Only 9 of the 20 correlations among attitude and skill test 
scores are statistically significant. Students who enjoy reading and/or 
rate grammar study as useful are, fto a limited degree, inclined to perform 
better on the skill tests. 

In summary, these findings indicate Statistically significant but 
modest relationships .between verbal ability aitd mastery of certain basic 
writing skills and between attitudes toward hnglish and mastery of those 
same skilt^ . 

* 

Attitudes and performance on the . " 

letter-uriting assignment. » 

^ Correlation coefficients calculated among the relevant attitudinal 
and writing skill variables are .given in Table 12, along with their correla- 
tions with students* scores on the Vocabulary test. For brevity, only the 
totals of students* ratings on the eight writing-assignment scales (Appendix 
D) is considered. (Cdrrel^t^cfTs among the eight ratingr-sCale scores range 
from .14 to .65.) Similari^r'only the Jto^Jal percent of word and sentence 
er^rs is covered in Table 12. , • . . . 

^ ' ' • / 

The following relationships are evident* from these data: 

(a) The interrelationships of the attitude scores are quite similar* 
in character t^o those reported in'Table 11-, i.e., modest interrelationships. 

(b) Students who received fthe best ej^iner ratings of their ^ 
letters tended tP have the lowest rates of word and .Sentence errors. ^ 
There is only a slight -correlatioh . (.29) between *?tudents* tendency to 

make word errors and their commission' of sentence errors. 



f 
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TABLE 12 Intercorrelations of verbal ability, attijude and performance on the letter 
writing assignment for 467 grade 7 to 10 students. 



Variable* 


2 


3 


4 


5, 


6 ; 


7 


8 


9 


1. Vocabulary Percentile 


38 




l?f 






37 


-32 


-22 


2. Enjoyment of Reading 




25 


19 


36 


38 ! 


25 


-23 


-18 


3. Enjoyment of English Closes 






33 


37 


' 1 

32; 


10 






4. Usefulness of Grammar 








27 


44 J 


14 


-18 


-13 


5.' Enjoyment of Writing 










3ol 
t 








6. Application of English Skills 








« 


t 


13 


-18 


-17 


7/ Total of Writing Assignment Ratings 














-50 


-28 


8. % of Word Errors on Writing Assignment 






i 










29 


9. % of Sentence Errors on Writing Assignment 



















*A correlation of .09 is required for statistical significance at p <.05; ..12 
for significance at p <.01. Non-significant correlations are not reported in 
this table. Decimars have been omitted for ease of reading. 



(c) Estimates of students verbal ability correlate positively' 
with the examiner ratings and negatively with their word and sentence 
error scores. . , - 



(d) Ten of the 15'^correlations among the 3 writing skill measures 
and 6 attitude measures are significant. To a limited degree, students 
who enjoy reading, rate grammar as useful and apply their English skills 
when writing tended to receive better ratings of their letters by the 
examiners and make fewer word and* sentence errors. 

It is noteworthy that none of the correlations between the Enjoy- 
ment of'writing Scale and measures of actual writing performance were 
significant. * ' , 

In summary, these findings indicate statistically significant but 
modest reratio^nships" between verbal abil/ty and letter-writing skill and 
between iitti;^des toward English and letter-writing skill. The pattern 
of relationships among attitude measures and between verbal ability and 
attitude measures is', quire similar for this sample of students to that 
observed for the previously reported sample (Table 11). 
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SUMMARY 



The intent of this report has been , to present detailed data in 
terms of Avhich.the adequacy of Intermediate-level students' achievement - 
of several attigtude ind skill objectives in the area of writing may., in 
part, be judged. 

^Two different groups of about 550 students each were administered 
different batteries of tests which contained a measure of verbal ability, 
short attitude scales and either a standardized test measuring knowledge 
of punctuation, capitalization, usaga. and 'spelling or a letter-writing 
assignment. 

A series of 12 tables, 3 figures and 10 appendices were included 
to provide detailed, item- level descriptions of students' performance on 
the various tests. . « 

Statistical analyses indicated that, in general: students' skill 
in writing improves over th^. grade 7 to 10 interval; girls' performance 
is consistently better than boys; students' attitudes toward writing 
tend to become more negative as they progress over the grades, with girls ^ 
attitudes generally more positive than those of the boys. 

Viewed in t^rms of kbsolute staitlards, students' performance in- 
writing tends to be either 'average' or 'below average'. There is a 
'suggestion in the pattern of students' responses that at least some aspect 
of their less-than-adequate performance are related to attitudinal factors 
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• APPENDIX A 



' ^ ■ • INTERMEDIATE ENGLISH 

STUDENT WRITING ASSIGNMENT INSTRUCTIONS 

* ■ , ■ 

* 

Write a letter to one of the followmjg^ j:hree persons. 
*~ ' ' ' 

4gThe body of tl»e letter shouFd be at least 20 lines. Write on 
every other, line. Pay careful attention to your grammar, spelling, 
punctuatibn, etc. You may use a dictionary. ^This assignment will be 
returned to y«ur teacher, who maty- use it la determining term marks. 



.\ IV prcgr^ whrch you are looking forward to viewing will not be 
shown In vour opinion, the progi'api to be seen jn its place is Uss 
interesting' ti.an thV originally S£h6duled show. Write a letter to . 
Mr K. L. Jones at CFEK-TV in this -city. Inform Wr. Jones, who is 
the statjos manager, of your concern by pointing out your reasons 
for liking the one program and not liking the other. Be sure to 
give convincing arguments in each case. Station CFEW-TV is located 
at 123 Newmarket Avenue. , 5 ' 

•1- I 

You recently bought a certain product. This product has failed to 
meet its advertised expectations. The local store which sold the 
Item refused to help you. Mrs. Ann Smith is the consumer relations 
officer at Ace Manufacturing Limited, the firm' which manufactured 
the product. Write to her at 419 Southern Avenue in Toronto. Out- 
line whatever background information is necessaiy and the complaint 
which you have "about the product. *Ask for her assistance in finding 
a so-lution to the problem. 

You are one of a group of students which wants to have a coke macPTine 
installed in your school; You have met with .the principal arid he is • 
not opposed to the. idea. Before the machine can be installed,' how- 
ever, permission must be obtained from the London Board of Education. 
Write to Mrs. Judy White, who is Gharrman of the Board of Education, 
and^explain the situation to her. Ask her 'assistance in presenting 
.this request to other Board members. Point Out the arguments in 
favour of the instsal l.afion of the machine which she may use in her 
Spresejitation.' The maili-ng address for the Board is P.O. Box 5873 

this city. ' ) ' 



APPENDIX B 

MARKING SCHEME FOR STUDENT WRITING ASSIGNMENT 
'* MECHANICAL ERRORS 



1. Dangling or misrelated participles-, gerunds or infinitives 
and dangling elliptical phrases 4nd clauses. 

2. Verb-subject agreement 

3. Pronouns 
(a) Pronoun-antecedent agreement 

'(b) Unclear, vague, or ambiguous antecedent - they, it, 
you, which, this or that 

4. Illiterate, slang, and sub-standard expressions 

(a) Diction - "anyvays", Virregardless", etc. 

(b) Verb forms - ''would of taken'' - improper tense*, etc. 

(c) Double negative 

(d) Adjectives used for adverbs 

(e) Case 

(f) Misuse of words 

(g) Unidiomatic use of preposition 

5. Faulty sentence structure 

(a) Incomplete sentence 

(b) Ambiguous sentence 

(c) Comma splice ' ' . 

(d) Run-on sentence ^ 
... (e) Adverb clauses incorrectly used as noun clauses 

6. Misplace'd or confused correlative^ 

7. Misplaced modifiers 

8. Shift in tense, person, or number 

9. Punctuation" j * " ^ 
... (a) Format 

... (b) Textual . * / 

10. Word Emitted- 

11. .Spelling 

12. Needless repetition 

13. Capitalisation 

14. Faulty parallelism i :) 3 
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ELEMENTS FOR LETTER FORMAT 



Street address, 
City, Province, 
Date. 



Name' of person. 
Institution, / 
Street address. 
City, Province. 



Dear 



, Yours sincerely. 



Signature 
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APPENDIX C 

TABULATION SHKT FOR STUDENT WRITING ASSIGNMENT. 



STUDENT NAME: 



STUpENT.'NO. 



Numfeer of words 



Niimber of Sentences 



Overall Ratings 



Scale 


1 


2 


3 


4 


■5 


6 


7 


8 



















Error Counts 



No. 


SymboT 


Count . , 


1 










- 2 


A^A 1 








3a 










3b 


Arvt ? 








4a 










4b 


V 








4c , 










4d 










4e 


C 








4f 


WW 










P/Uf 








5a 


.Iric 








5b 










5c 


CS- 








5d 


RO- 








5e 


Aa.v.C< 









No. 


Symbol 


Count 


6- 










7 


KM 






c — r- 


8 


S 








9a* 










-•9b 










10 


W'.O. 








11 










12 


Rtp 








13 










14 


il 









Note — 

^ All error counts treated 
as 2 digit numbers^ right 
justified. 
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~ APPENDIX D 

SCALES USED TO, RATE EIGHT DIFFERENT ASPECTS OF STUDENTS' WRITING ASSIGNMENT. 



Rating 
3 



SCALE 1 - PRESENCE OF, AND SUPPORT FOR, A CENTRAL THEME - 

Characteristics 

- *A significant central theme is obviously present, and 

is - 

supported with concrete, substantial and consistently 
relevant detail. 

A central th/me is evident but is too general or trivial, 
and is.... 

supported by concrete detail, but detail that is 'occasion- 
ally repetitious, irrelevant, or sketchy. 

A central theme is nofevident or is confused, or is... 
unsupported by concrete and relevant detail. 



Rating 
. 3 



SCALE 2 - ORGANIZATION OF THE THEME 

Characteristics 

logical plan of development of the theme 
clearly ordered stages 

developed with originality and consistent attention to propor- 
tion and emphasis 

paragraphs unified and effectively developed 
transitions between paragraphs explicit and effective 

plan-and method apparent but not consistently fulfilled 
occasional dispr6portion of inappropriate emphasis 
paragraphs unified and generally effectively developed 
transitions between paragraphs weak ar mechanical 

plan and purpose of theme not apparent f 
undeveloped or developed with irrelevance, redundancy, oj 
inconsistency 

paragraphs not unified or developed 
transitions between paragraphs lacking 



SCALE 3 - SENTENCE STRUCTURE 
Characteristics 

- sentences s-killfuUy constructed - i.e.. unified,, coherent, 
forceful, effectively varied 

-(Sentences correctfy constructed but lacking distinction 

- sentences not unified, fused. incomplet<t. montonous or 
♦childish 



SCALE 4 CLARITY AND EFFECTIVENESS , OF COMMUNICATION . 

Charaoter^istias 

t. 

«i 

- clear. and effective expression (message clear) 

- language fresh, precise , ^economical and idiomatic 

- clarity and effectiveness impaired occasionally (message 
clear, with some minor exceptions) 

- language correct but pedestriaij, tendency to wordiness 

- communication obscured (m.ess«ge not clear) 

- language ambiguous, unidiomatic, rambling, vague 



SCALE 5 - IMAGINATION, FRESHNESS, VITALITY, RICHNESS 

Characteristics * 

- imaginative, fresh, vital, rich production ^ 

' - evokes very positive affective reaction in reader through 
use of humour, literary devices, or original ideas, / 
perspective % v 

- spme imagination and vitality, but ratherr commonpUc^ 

- occasional use of a literary device or humour ; / 

- dull, unimaginative, pedestrian, impoverished, lafK^ng color 

- complete .absence of humour, litferary devices, originality/ 
perspective, ^ ' / 



/ 



Rating 
3 
2 

1 



SCALE 6 - HANDWRIT^G 

Chayaoteri'stics 

Excellent - easy to read; clear, well-formed letters 

Average - generally easy to read, but occasional difficulties 
in interpretation 

Poor - a struggle to decipher, many instances in which letters 
unrecognizable, no space between words, etc. 



Rating 
3 



SCALE 7 - FOLLOWING DIRECTIONS 

\ 

Characteristics 

Student has followed directions carefully - . / 

- written on every other lina | 

- used letter format v. . i 

- included all of pertinent informat;ion given,^ e.g., address 

- responded to specific, directions - e.g., giving reasohs, 
explaining the situation . | 

Student has followed directions wi4:h respect to th^ iiiai|i intent 
of the assignment, but has - 

- failed to write 'on every other line, or 

- not used letter format, or ^ , ' 

- le^t out pertinent details, e.g. address 

Stuc^nt has really not grasped the main intent of the assignment, 
included pertinent detail nor used the' appropriate format. 



Rating 
'5 

4 
3 
2 
1- 



/ SCALE 8 - USE OF LETTER FORMAT 

i 

Characteristics 



.All 4 elements done correctly, i.e< 



- element in correct position 

- all unirs in element present 
, - units* in correct order 



r 

t 



I 3'of 4 elements done correctly 
} 2 of 4 elements done correctly 
1 of 4 elements done correctly 
None of 4 elements done correctly 

NOTE: -- Punctuation errors are not considered in making these 
ratings. 
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APPENDUC E 

SCALES USED BY CLASSROOM TEACHEI^S'tO RATE THEIR CLASSES 
AND THE TESTS BEING ADMINISTERED 



INTERMEDIATE ENGLISH PROJECT 
TEACfiER RATINGS" OF CLASSES AND TESTS 



There are three major related difficulties in trying to evaluate 
any program in any subjdct area: ^ deciding what program objectives^ to 
assess; determining how to assess them and, finally, locating or. devel- 
oping some stccndards in terms of which evaluative Judgements can jnade. 

'*With the help of various groups of teachers, the English study 
committee has selected which elements of the Intermediate Program to • 
assess first and has selected or developed some tests for thi? purpose. 
The committee, however, is not completely satisfied with all the tests 
and needs your help in both evaluating their appropriateness and creat- 
ing some general standards against which the adequacy of students' per- 
formance on them can be judged. - . ^ 

In order to make it easier for you to communicate your opinions 
and judgements, the Committee has developed the following set of questions 
which it would like you to answer. Some of the questions ask you to rate 
your class in general terms; some are concerned with estimates of your 
class's performance on the tests, and 'some are concerned with your opinions 
about the appropriateness of the tests and performance standards or goals 
for them. 

Even though some of the questioT)S may seem impossible or ve'ry 
difficult, please try to answer all of them as Trankly as 70U can. 

'Because we will want to relate student performance to some of 
the ratings you give, it is necessary to have you identify yourself on 
the questionnaire form. However, you may rest assured that you will not 
be identified in any written reports and your responses will be treated 
as confidential information. The purpose of this project is to evaluate 
program, not people. ^ . 



If grade 9 or 10, course in:ode (e.g. Eng. 251) 
and title ^ 



Number of different English classes taught this year. 



PART I X RATING OF THIS CLASS 

Give, a general assessment of this class by making the following 
ratings . ^ 

Compared to all of the other classes at this grade'level that I 
have ever taught, this class 



is better than average in academic ability 

is of average academic ability 

IS below average in academic ability 



seems to enjoy E*iglish more than most classes 

shows neither special enjoyment nor distaste for English 

doesn'jt'seem to enjoy English as much as most classes 



possesses ver>' good. English skills 
||has average English skills 
IS weak in English skills 
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APPENDIX F 

TEST SESSION EVALUATION SHEET 



CLASS: 7 8 9 10 

Teacher ' s. Name School Grade 



BAHERY I II III IV 'V 

(a) What degree of effort did the students put into doing the tests? 

* \ 

I I good, conscientious effort . \^ j 

I |l , average effort ^ \ 

D gave Only minimal effort 

I I 'gave sufficiently little effort to * 
'perhaps iwalidate the tests • 

\ 

* 4 ' , 

(b) To what degree was the testing session free of interruptions, e.g., 
P. A. system, someone at the dooj;, unruly student, etc.? 

I I no interruptions at all 

I I only minor interruptions 

□ enough interruptions to interfere 
' • significantly with testing 

rn serious interruptions, p^erhaps 
invalidating the tests ^ 

(c) What was the general attitude of-the class toward doing the tests? 

I I very positive 

^ d] slightly positive 

Q neither obviously positive or negative ' 

I I slightly' negative 

r~l very, negative 
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. APPENDIX 6 

Mean number and mean percent by grade of each of 16 sentence errors m^de by stu 
on the letter writing assignment.* 



Type of Sentence Error ' 




Grade 




\ 

7 


8 


9 




1. Dangling or misrelated participles, 
gerunds or infinitives, and dangling 
elliptical phrases arid clauses 


N 
% 


0.2 
3.0 


0.3 
5.3 


0.2 
3.7 


0.3 ■ 
5.2 ' 


^ r- ^ > ■ 

• 2. Verb- subject agreement. 


N 
% 


0^ 

1 4 


0. 1 
0. 8 


0.2 
2.1 ' 


0. 1 

1.3, • 


3. (a) Pronoun-antecedent agreejnent. ^ 


N 

% 


0.6 


0. 0 

1 . 1 


0.0 
0.5 


0.1 
0.9 


'3. (b) Unclear, vague, or 'ambiguous ante- 
cendent - they, Hjj^you, which, 
this or that. . - . 


N 
% 


23.3 


i;4 

19.4 


* \.o 


.1.0 
13.0 


4. (a) Diction - "anyways," irregardless 
etc. 


N 

% 


0. 9 
14.0 


0.8 
11.4 


1 0.6 
' 10.5 


0.5 
6.5. 


4. (b) Verb, forms -'"would of taken" - 
1 improper tense, etc. 


N 
% 


3 

.4.8 


' 0.4/ 
5 .6 


0.3 
4.3 


0.3, 
3. 1 


, 4. (c) Double negativjs. 


N 

% 


* 0 0 
0. 1 


0 . 0 
0.3 


• OTO 

0.0 


0.0 
0.0 


5. (a) Incomplete sentence. 


N 
% 


0. 5 
6.1 ■ 


0.3 
4.3 


0.3 

3-. r 


0. 2 
,2.8 


5. (b) Ambiguous sentence. 


. N 
% 


0 1 

1.8 


0. 2 
2.8 


0.0 
1.8 


■ 0.1 
1.3 


j» 5. (c) Comma splice. 


N 
% 


4.4 


0. 2' 
4.2 - 


0.3 
4.7 


0.1 
2.3 


1— ^ r— ^- 

* 5. (d) Run-on sentence. 


N 
% 


0. 5 
' 7.6 


-0.5 

8.0 


0.5 
9.5 


0. 2 • 
3.4 


5. (e) Adverb clauses incorrectly used 
; • as noun clauses * 


N 
% 


0. 0 ' 
0.0 


0.0 . 

0.2 


0.0 
0.0 


0.0 
0. 1 


6. Misplaced or confused correlatives. 


N 
% 


n 1 
1.5 


0.0 
0.6 


0.0 
1.2 


0. 1 
1.0 


9. (b) Punctuations- textual 


N 
% 


4.3 

'54.0 


4.7 
56.8 


4.8 
60.8 


4.3 
j 54.4 
■ 


12. 'Needless repetition. 


N 
% 


0.2 
2.2 


0.2 
2.0 


0.2 
3.3 


0. 1 
1.4 


14. Faulty parallelism. 


N 

% 


0.0 
■ 0.7 


0.1 
0.8 


0.1 
0.9^ 


0. 1 
0,8 
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APPENDI)^ G - Continued 



*The mean' percentages reported in this appendix were calculated by dividing the 
number of errors of a particular type made by a student by the number of sen- 
tences he wrote and multiplying the result by 100. The resulting perceritages 
were then averaged across students, separately by grade, for each type of 
error. 

Slight apparent* inconsistencies between the mean humber and mean percent of 
errors are due to the fact that the 'figures were rounded for .inclusion in this 
appendix. ^ ^ 



\ 



APPENDIX H 



'Mean number and mean percent by grade of each of 9 word errors made by students on 
the letter-writing assignment.* • * 



1 

^ Jyp^ 0^ Word Error 




Grade 


7 • 


8 


9 ■ 


10 


4. (d) Adjectives used for adverbs 


N 
% 


0.0 
0.0 


. 0.1 
0.1 


. 0.0 
0.0 


0.0 
0.0 


4. (e) Case 


N 
% 


O.O 
0.0 


0.0 
0.0 


0.0 
0.0 . 


0.0 

0.0 , 


^^-^^ 

4. (f) Misuse of words 


N 
% 


1.1 

1.0 


1.3 
1.0 


^ 

1.0 
0.9 


1.0 
0.7 


4. (g) Unidiomatic use of preposition 


I 


0.8 
0.8 


0.8 

0..6 . 


'b.7 
0.6 


0.9 
0.7 


• It 
* 

7. Misplaced modifiers 


N 
% 


0.1 
0.1 


0.2 
0.2 

ii — 


0.2 
0.2 


0.1 
J 0.1 


8. Shift in tense, person, or number 



N , 
> % 


0. 1 


' 0.1 
^ 0.1 


0.1 
0.1 


0.0 

• -0.1 ■ 


10. Word omitted ^ * 


N 

%. 


0.5 
0.5, 


0.5 
• 0.4 


0.6 
0.5i 


0.4 
0.4 


11. Spelling (number of different words) 


N 
% 


3.6 
3.3 


2.8 
2.2 


3.0 
2.8 


2.3 
1.9 


13. Capitalization ^ 

. 


N 
% 


0.9 
0.9 


0.8 
0.7 


0.8 
0.8 


0.6 
0.5 



'^Percentages in this- appendix are based upon dividing each student's number of 
errors of each type by the number of words he wrote and multiplying each result ^ 
by 100. The resulting percentages were then averaged across students, separately 
by grade, for each type of error. 
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APPENDIX I 

FIVE UNEDITED STUDENT LETTERS REPRESENTING PERFORMANCES 
AT THE 10th', 25th, 50th, 75th AND 90th PERCENTllp 



^lOth. Percentile 



PcP. 



419 South Avec^ 
Toronto, Ont^ 



. >?/?^J^ear Mr^Ann Smithy 
" {fifk C^/i. . I. have taken action (to) the J^elfth ^reet store in a bad 
i^^Mfra^e ^ n^g^ they told me I could not get ray raoney ba^k for©' 
item supposedly able to cut wood, [But it can't cut paper it is 
\J, so dullT] iG'illlhope you will help rae^this raatter. 
Tha^ik^u for your tirae and jjaitlon^ ^• 
" jt^i; PcP, Yours^truly^ 



Overall Ratings 



M.H. 





Scale 


1 


,2. 


3 


4 


5, 


6 


7 


8 


/ 


/ 


/ 


Z 
_ 


/ 


/ 


Z 


3 



25th Percentile 
i 



Chairman of the Boar^^ 
P.O. ^Box SB71>c 
London, Onta^^l^^ 



i ^falLi o^ 



V)S> V/oV^*^^ machine and(<ej are asking assistance in taking th^s request- 
' (Uv^.to the- other raerabers of the($bard. ' We. hope you argue ^n^favour 
fa^)of this raachineQ 
fl^f I V "Veryr truly yours£^ 



T.McD. 



ERLC 









Scale 








1 


2 


3 


4 


5 


6 


7 


8 


2 


; 


2 


2 


y 


2 


/ 


3 
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Appendix I - Continued^ 



60l4i Pei*centile 



c 



R'vO. Box 5873^ 
London^pnt. 
'February 19/74^ 



Dear Mrs. White; ' ^ ' x ^ 

The G.A.A would like your peannissi on to have a coke machine 
Ayi in our ca<eij)feria because the |grics>'^ drinks at 'the counter^iT) 
up to twenty five cents for a small drink and thirty cents for a 
JA^^ large one. |jVe have had a vote and^m^i^ity ^inp the votes were 
^^<^ 2,000 - 50 J All the students ar6 starting to bring tll^rj) c^wn pop 
ff^¥\ 5f.6^^^^^ prices} I think tWt the machine be in good 

^^^thands and will make good business^^Our principal says that ^t^ 
^^^and we think' that ^ would be a fairly good. idea. 

i ^ Y.ours 
^' ' CA 



Of. 



Overa] 1 Ratings 
Scale 
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Appendix I - Continued 



?5th Percentile 
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February 2%.1974cs.' 
1000 Netker Avenue^ 
London^-Ontariot, 
N6A 3T2. 



Ms. a: Smithy. " . ^ ^ - 

Consumer Relation^ ' jT , ^ * ^ < - • . . 

Ace Manufacturing Lin\itec|^» 
fif, 419 Southern Ave-c ' . ' ' " ^ 

^ /i/; Toronto^ ' . ^ . ^ ^ 

Dear Ms. Smith, . ^ ' ' 

' I recently purchased a tube of Grip-^ll al^^^l^rpose gl^e. 

I was encouraged to purchase this product by an advertisement on 
television stating it was the ^'strongest glue manufactured in the 
/\ L 20th century." Pi obviously trusted this commercial to do the job 
wanted, (not suspecting any minor flaws in ^t^ability.^ i 

.Several days 'after seeing this commercial my baby brother's . 
crib' broke. The end leg, at the foot of his crib had^snapped 
^j^^ several inches from the mattres^ I did not want to trust Just 
any giue^so I put .my faith ip the advertis'ed^pro'Uuct . 

I purchased this glue at Simpson's DepartmentStore using 
our charge-.plate. I fixed the leg^ following all labelled 
f^tftUirections^and giying it time to dry. The following night^at 
rS)) 11 •04(^"^y^rother started cryin^his crib had brol(^he exact 

^^position where it had preyic^usly brokei^but^s mende^with the 
^l^^/glue. Had I not awake^t my brother's cry^he may ^ suffocated 
in his bed coyerings. I felt disappointed in(^ product not^ 
living up tn' fix nectations expecte d from ir. I went to Simpson's^ 
^^^^^main branch in London^where I had bought ''Grip-All'^ but tl(e)refused 
£f to refund my. money. .1 inquired why^and the store clerk ^r'feplied 
^^^•^(jlof^rm sorry/' Could you please assist me in my well earned 
ti^'.Pttrefund^ Thank you for your assistance^ . OveraH Ratings 



e.r; 



Scale 


1 


2 


3 


4 


5. 


6 


7 


8 


B 


2 


2 


3 


3 


z 


■3 





Appendix 1 - Continued 



90th Percentile 



\ 112 Lobo Drive , 
' London, Ob^tario, 

February 19, 1974^ 



Ace Manufacturing Ltd., 
* 419 Southern Avenue, ; - 

Toironto, Ontario. ^ ^ 

Att'n: Mrs.' Ann Smith 

Dear Mrs. Smith, ^ * 

' Your company* has a product on the market called the Kwiki ^ 
Klean-up Ra^ According to your advertis^iftent on' television, this 
rag should pick up twice as much dirt as an ordinary cloth. You'^ 
f^^ also say that it^^n^ill last for years." f found both these ^ ' 
Sp^ ^tements to be untrue. I had to re-dust the;furniture with an 
' ordinary>cloth before the dust was^picked up.^ I then washed your 
rag(6^ in an automatic machine ,|3^hich should be safe according 
to your advertisement]]! and the cloth came out with large holes 
\/7 in it. I tr^ied to rfeturn it to^ the. store at which I (£ad gotten) 
^jt/iit, but- ^he^ refused to refand my money, or give me an exchange. 



^ ^ I showed them the receipt as well as the rag. Th^ told me to 
write to the manufacturer. 

I hope you can give me more satisfaction. 

Yours truly, 
, - . . D.McC^ 



Overall Ratings 



Scale 


1 


2 


3 


4 


5 


6 


7 


8 


2 


3 


3 


2 


3 


3 


2 





APPEN&IX J ■ 

: PERCENT OF STUBENTS/BY GRADE,. PASSING EACH ITEM OF SUBTESTS 3, 4 AND 5 
^ OF THE COMPREHENSIVE TESTS OF BASIC SKILLS ■ 



Subtest 3; . Items 1-13; PunatuaHon 



level -3 



Level 4 



ber 


'Grade 7 


Grade 8 ^ | 


Grade 9 


Gl 


rade 1( 


3 


a 


London 


Norm 


* 


c 

Q 
•0 

C 

Q. 
<<^ 


Norm 


* 


London 


;§ ' 


* 


London 


Norm 


* 


1 


59 


' 79 


60 


67 


83 


67 


43 


41 


■43 


44 


37 


. 44 


2 




67 . 


64 


66 - 


' 66 


66 


■78 


89 


79 


84 


3-9 


85 




""75 


65 


*75 


72^ 


70, 








48 


65 


64 


65 




61 


-58 


61 


63 


61 




i 




69 


79' 


62 


79 


&— 




82 


57 • 


Gl 


06 








- 81 


88- 


-.84— 


88 


. . 6 


68 


69 


68 . 


72 


' 75 ' 


72 


si" 


65 


53 


58 


68 


58 


7 


78 


. 68 


,'79 


77 


' 75 


'78 


65 


69 


65 • 


•72 


75 


72 


,8 


,64 


' 69 


64 


73 


70' 


73' 


72 ■ 


74 


72 


74 


?5' 


73 


' 9 


80 " 


• 77 


80 


• 85 . 


78 


85 


4-8 


44 


48 


53 


48 


53' 


10 


80 


79 


80 


80 


81 


80 . 


66 


61 


67 


69 


71 


68 


11 




69. 


66 


69 


75 


69 




81. 


82 . 


83 


87 


82- 


12 


76 


'74' 


76 




77, 


78 


79 - 


83 


80 


85 


B3 


85 - 


13 


85 


86 ' 


86- 




89- 


89 


81 


77 


82 


88 


84 


87 



♦Percent 
item. 



passing based only on those students-vho actually tried the 



APPENDIX J - Continued 



Subtest Z; It^s, 'l4-25; Capitalization 





,Eejiel 3 


^ w >^ ^ ■ 

Level 4 




Grade 7 




Grade 


8 






G- 


rade 1 


0 




London 




★ 


London 


1 
ia; 


* • 


r 

London 


g 


* 


London 


1 




14 


67 


69 


71 


63 . 


72 


63 


58 


63 


60 • 


73 


'68 


73 . 


15 


43 


' 55 


' 47 


43 


64 


43 


,66 


72 


70 


'79 


76 


81 


16 


28 


40 . 


32 


24 




24 


73 


81 


79 


83 


85 


83^ 


^ IT 


51 


'58 


60 


64 


61 




66 


67 


77 


•, 73' 


79 


80' 


81 


18 


51 


46 


61 


47 


56 




■ 50 


' 33 


39 


38 


34 


32 


35. 


19 


35 


■57 


44 


40 


60 


■44 


17 - 


34 - 


20 


24 


36 


. 25 


70 
21 


65 ■ 
63 


■ 69 

75 


82 
82 


■ 76 ■ 
78 


72 

77 


85 
89 


59 c 
63 


■B2 
72 ■ 


' 71 

'78 


66 
74 


b'6 

72 


— rr 

82 


22 


47 


56 




60 


56 


72. 


30 


' 46 


39 


' 42 ' 


■ 51 


50 


23 


|47 


60 


66 


64 


66 


79 


V9 


61 


64 


64 


59 


75 


24 


27 


47 


38 


39 


53 


50 


■ \ 
53 


69 


73 


66 


65 


81 


25 


1 31 


53 


45 


• 

'34 


57 


44 


39 


51 


55 


53 


57 


65 



♦Percent passing based only^on those students, who actually t^ied the 
item. ' * ' 



1 



* 










- 














- 




/ 








* 




6 








✓ 
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APPENDIX J - 


• Continued 


















• ■ 














Subtest 4; 


Items 


26-45, 


Usage 




• 
















Q) 


• C 


Jrade 7 


Grade 8 


Grade 9 


Grade 10 






z 
s 

Q} 


1 London 


Norm 


* 


London 




* 


London 




* 


London 


1' 


* 






26 


58 


■ 66 


58 


48 


■ 6? 


48 


75 


70 


75 


. 78 


78 


78 






27 


60 


61 


60 


64 


66 


64 


60 


60 


60 


72 


68 


XT-. 

72 


• 




2o 


86 


86 


86 


86 


90 


86 


79 


62 


79 


84 


68 


' 84 








' 93 


88 


93 


91 


88 


91 ■ 


57 


68 


57 


59 , 


62 


60 


i 






70 


61 


70 


66 


63 


66 


77 


81 


77 


•83' 


84 


82 






7 1 
01 


1 38 


SI 


38 


54 


64 


54 


79 


72 


79 


72 


74 


72 






7 O 


C7 
OO 




53 


C A 


66 


54 


88 


82 


88 


87 


86 


86 


/' 




7 7 


47 


49 


47 


52 


~ 68 


^ 


74 


71 


74 


73 


78 


72 






ZA 
OH 


91 


8C 


91 


92 


88 


92 


34 


62 


34 


. 57, 


68 


57 






7 r 


—dJ — 


' 70 - 


6/ 


70 


7.2 


70 


74 


72 


74 


77 


72 


* 77 






i 

OD 


52 


64 


'52 


58 . ~ 


' 67 • 


58 


88 


89 


88 


90 


87 


90 




- 


7 1 

37 


55 


66 


55 


70 


69 


70 - 


84 


82 


85 


92 


90 


91 






38 


71 


62 


71 


69 


70 


69 


76 


71 


78 


' 82 


76 


83 






39 


'75 


76 


75 


80 


76 


80 


79 


78 


80 


79 


78 


80 






40 


7-0 


70' 


70 


77 


70 


77 


50 


■60 


51 


67 


66 


68 






41 


58 


69 


58 


65 


61 


65 


54 


62 . 


■55 


62 


71 . 


63 






42 
r-" 1 — 


63 


68 


65 


65 


■70 


65 


67 


66 


69 


58 


66 


60 






43 


77 


' 78 


8b . 


'91 


79 


91 


63. 


60 


65 


70 


71 


71 






-•44 


60 


69 


' 62 


67 


'74 




46 


66 


47 


54 


66 


55 






t 

45 




70 


69 


77 


71 
— -s — L 


?€ 


44 


42 


45 


44 


48 


44 





*Percent passing based only on those students who actually tried the 
Item. 
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INTERMEDIATE ENGLISH EVALUATION PROJECT PUBLICATIONS 



[Ackie, L. Background, and Plan for the Intermediate English Evaluation 
\ ' Project/ Board of EcTucation, London, Ontario, 1974 (mimeo). 

dickie, L. & Rice,. E. T. Intermediate English Evaluation Project: Stating 
the Objectives. 'Board ofEducation, London, Ontario, 1973 (mimeo) 

Stennett, R.^ €. , Dickie, L. , Rice, E. T. , Clift, G. & Waite, N, 

Intermediate English Evaluation Project: Student Attitudes. 
Board 'Of Education, London, Ontario, 1973 (mimeo), 

Stennett, R. G; &^ Isaacs', Lonta. Intermediate English Evaluation Project: 
Survey of^Teackers. Board of Education, London, Ontario, 1974 
(mimeo) . 

M^les, S., Dickie, L. , Rice, E. 6 Stennett, R. G. Intermediate English 
Evaluat%on Project: Community Attitudes. Board of Education, 
London, Onta^i/), f973 (mimeo). 

Stennett, R. G. & Isaacs , Lorna. Intermediate English Evaluation Project: 
Survey of Studen? Achievement - Overview. Board of Education, 
London, Ontario, 1974 (mimeo). 



Stenrtett, R. G. 5 Isaacs, Loma. Intermediate English Evaluation Project: 
Reading - Student Attitudes and Achievement. Board of Education, 
London^, Ontario, 1974 (mimeo). 

Stennett, R. G. & Isaacs; Loma. Intermediate English Evaluation Project. 
Writing -'StuBent Attitudes and Achievement. Board of Education, 
London", Ontario, 1974 (mimeo). 

Stennett, R. G. & Isaacs, Loma. Int^rm.ediate English Evaluation Project • 
Listening. Board of Education, London, Ontario^, 1974 (mimeo). 

Stennett, R.Jt. & Isaacs, Loma. Intermediate English Evaluation Project 
Speaiainn, Board of Education, London, Ontario, 1974 (mimeo). 



Stennett, R. G. & Isaacs, Loma. Intermediate English Evaluation Project 
Verbal Creativity. Board of Educatiop, London, Ontario, 1974 
(mimeo). j 

Stennett, R. G. 5 Isaacs, Lorna. Interm.ediate English Evaluation Project 
Attitudes Revisited. Board of Education, London, Ontario, 1974, 
(mimeo). \ 

Latimer, R. D." '^k -v.rvUi: :/ the English :.^juaje Arts Progrars - 

Intemediate Zivision, City of London Schools.' Mini.stry of Educa 
tion, Ontario i 19'73 (muoeo^*^ • ' • • 
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INTERMEDIATE ENGLISH EVALUATION PROJECT: LISTENING 



R. G. Stennett, Ph.D. 6 Lorna Isaacs 
Educational Research Services 

Research Report 74-10 



'This report is one of a series of six which describes in detail 
student attitudes and achievement in major areas of the Intermediate 
English program. The six reports, in turn, represent one major segment 
of thefneeds assessment phase of an overall 'evaluation plan which has 
included prior surveys of the community, faculty and students and a 
special goals-specificatian project. . , 

■ Because of the size and complexity of the achievement assessment 
phase of the evaluation project, a 'preface' paper has been prepared which 
gives ajl overview of the project and describes the sartpling procedures, 
subject population, testing strategies, program objectives evaluated etc. 
(Stennett 5 Isaacs, 1974). The current report has been written on the 
assumption that the reader will have i^ead this 'preface' paper before 
reading this one. 

This report outlines the students sampled, the attitude and skill 
objectives evaluated, the tests and scales used and the statistical tech- 
niques applied. ' 



A major limitation of this and other reports in this series is 
the absence of clearly-stated standards or expectations of student perfor- 
mance against which their actual performance can be evaluated. Really 
appropriate value judgements abovit the adequacy of student Performance 
require the development of expl icity-stated , detailed performance standards 
- keyed to student age and ability differences - about which there is at 
least a reasonable degree of local consensus. 

The findings provided in this report, therefore, represent one of 
the important bases necessary for judgements about whether or not the 
current level of skill in listening is "adequate". In and of themselves, 
they do not allow such judgements. ^ 



METHOD 



Sc^l^ing of Students ^ 

A total of 528 stud'ents was included in the sample used to assess 
listening skills. As indicated in the*' preface ' paper (Stennett 6 Isaacs, 
1974) this group of students is quite representative of alL Intermediate 
Division stude^s in terms of age and sex composition. The grade 7 and 8 
students are somewhat more capable, and the 9 aivi IG students slightly 
less capable, as measured by their performance on the vocabulary subtest 
of the Comprehensive Tests of Basic Skills. They are fairly typical of 
all students in terms of their rated 'Enjoyment of English Classes . 

i 01 
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S'tjeotives Studied and Tests'^ Used ^ ^ .-t 

Since no specific attitudinal objectives regarding listejiing were 
studied, in. this secticjn the skill objectives w.ill be listed and the test 
used to assess them de^ribed. ' ^ 

» Objectives: To have students be able to follow a verbal presenta- 
tion and: (a) acsess the speaker's information^ qualifications^ intentions y 
and presentation; (b) decide to accept or' reject any part or whole of a 
speech, i.e. to decide: ii) whether the speaker is informed or misinformed j 
Hi) whether the speech is logical or illogical , effectively or ineffec- 
tively presented^ and (Hi) whether the various points made by the speaker 
are relevant or irrelevant, complete or incomplete. 

7he extent of student achievement of this objective was assessed 
by administering the STEP Listening Test (1957). Form 3i$ was given to^ 
students in grades^?, 8 ahd 9, Form 2A to grade '10 students. Due to time 
limitations t)nly 66 of 80 items of Form 3A, and 60 of 72 items of Form 2A, 
could be administered/ . \ - ' 

The items comprising this test can be grouped to assess three major^ 
skills: (1) Plain-sense Comprehension, i.e., identifying main ideas, remem- 
bering significant details, remembering simple sequences of * ideas djxd under- 
standing ^denotative meanings of important words; (2) Interpretatior^,^ i.e., 
understanding the implications of main ideas, understanding the iinplications 
of sianificant details, and understanding the interrelationships covong ideas 

- and oon no t at ivo meaning o; i^) E v aluation of^ Applicat io 'n^ i.e., judging ~ 

validity and adequacy of main ideas, judging sufficiency of supporting details, 
criticizing organization, judging whether the speaker has created the intended 
m^od or effect, and recognizing the speaker's intent. 

In this test, students listen to an examiner read aloud brief passages 
of different kinds of material and, after each, answer a short series of 
multiple-choice questions. 

'Test Adrdnistration I 

The STEP Listening test was administered to students in their normal 
class groups by specially trained testers (Stennett 5 Isaacs, 1974). During 
testing, ^he qlassroom teacher was askefi to rate both his class and the test 
on a number o^ simple, locally-produced scales. After each, of the two test 
sessions, the tester completed a simple evaluation form which allowed, her to 
rate the adequacy of the testing session. 



7^3 1 'J^-c^ring and Data Ana uy sis 

The STEP Listening test was scored by computer using programs 
specially written for the purpose.^ 

. « 

*The Committee wishes to thank Kayne Kelly of Computer Services for his val- 
uable help v^ith this and all other data processing aspects of this project. 



All-^'a were punched into data cards , ^verified and subsefluently 
edited by computer. The major analyses consisted of: 

fa) calculating means and standard deviations; and preparing fre- 
quency and percentage frequency distributions for all variables, ^epar^tely 
for grade and grade-sex groupings of students; ^ . . 

"(b) calculating one-way analyses of variance (ANOVA) across grade" 
and grade- sex groups for all major 'scores or subscores, and 

(c) intefcorrelating the major^cores and subscores, * . 

" ■ » 

' Because it was not possible to administer all test items to the 
students, percentile equivalents for students' raw scores could not be - 
calculated. Comparisons of London students ' performance with that of tlie. 
1957 American standardization sample are, therefore, not possible in this 
regard.' • Hov^ver, since the test publisher does provide percent passing 
figures for each item, comparisons of London students' performance with 
the standardization sample oqn be made at this level. 

RESULTS 

• The percents of i:ondon and standardization sample students passing 
each STEP Lis tening Test item are presented, separately by grad e, for the 




three majoT subscales of Plain-senSe Comprehension. Interpretation, and 
Evaluation and Application in Tables 1 . 2 and 3 respectively. Summaries 
of the aveLges of these percent-passing figures, across items within eacH 
subscal^. hv the two groups of students are given, by grade, in Table 4. 

The relder may note that, within each of the three major subscales. 
items have been further classified to indicate in greater detail the partic- 
ular skills being assessed. The items comprising the Plain-sense Comprehen- 
sion subscale' (Table 1) have been divided into th« following four areas: 
identifying main ideas, remembering the sequence of ideas, understanding 
denotative meanings, and remembering significant details. The Interpreta- 
tion subscale (Table 2) is broken down into four areas: understanding the 
implications of main ideas, und^standing connotative meaning, understanding 
the interrelationships of ideas, and understanding the implicati^lis ot 
significant details. Evaluation and Application subscale items (T^le 3) 
are divided into five areas: judging the validity of ideas, judging -the 
sufficiency of details, criticizing organization, judging mood and effect. 
. and recognizing the intent of the speaker. * 



^A'concerted effort to develop a workable pro-rating scheme to adjust London 
students' scores and thus use percentiles failed, primarily because of the 
different difficulty level of the items which were administered compared 



with those not administered. 



An examination of the figures presented in Tables 1 to 3 indicates 
that the pattern of London students' performaijce follows that of the stan- 
dardization sample students quite closely. London students do not exhibit 
any particular strengths or, weaRensses in the area of Listening skills. 



TABLE 1 Percents of London and standardization sample students passing 

STEP Listetii^. Test items dealing with Plain-sense Comprehension. 
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TABLE 1 - Continued 
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•Percent passing figures for the normatLve group of students are 
based upon Fall' jesting; London students were tested in February 
and March. • . 
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TABLE 2 Percents of London and standardization sample students passing 
STEP Listening test items dealing w^h Interpretation. 
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►Percent passing figures for the normative^^^roup of students are based 
upon Fall testing; London students were tfested in February and March. 
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TABLE 3 Percents of London and standardization s_^ple students passing 
STEP Listening test items dfealing with Evaluation and Applica- 
tion. . .^^ . ^ 
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*Percent paesing figures for the nhmative group of students cace based 
upon Fall testing; . London' students were testid in- February and March. 
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Thexlata of Table 4 indicate that, in general,. London students m 
grades 7 and 8 exceeded the performance of the standardization sample 
students, whereas grade 9 and 10 students' performance is slightly below 
that of this reference group. This -finding parallels the verbal ability 
differences between the elementary and secondary students noted _earlier ^ 
in this report-.- Considering the substantial 'memory' and 'understanding 
requirements of the Listening test, this parallel was probably to be 
expected. ' • - 



TABLE 4 Mean of pereents of London and normative populatipn students pass- 
ing items on the Comprehension, Interpretation and Evaluation, and 
Application Subscales of the STEP Listening Test, by grade. 



Subscale 
(Number of items : 
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Table 5 gives^ the mean number of items correct, by grade and sex, 
for the three listening subscales. ANOVA tests failed to indicate any . 
statistically significant, differences between the perf ordnance of boys and 
, girls on any, of the subscales at any grade level-. „ ^ ^ 

Because grade 10 students took a different level (2A) of this test 
than students in grades 7. 8 and 9 (3A) . comparisons can only be? mad6 for 
the latter three grade groups. ANOVA tests revealed statistically sigmfi 
cant differences on, all thrfee subscales only between the grade -and grade 
8 groups. The 'relatively' poor performance of the grade 9 students is 
probably related to the ability differences noted earlier. , 



TABLE 5' Mean number df items correct, by grade and sex> .for the three STEP Listen 
ing Subscales of Plain-same Comprehension, Interpretation, and Evaluation 
and Application, 
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* . ♦ ' : • 

**M ='{n3le; F = temale; ^T - tojjal of male and female 

* i 

/ 

Interrelationships among ^measures of ability^ > ^ 

.attitude listening bkills. 

j Table 6 presents Pearson product-mbment correlations calculated 
among 4 set of ability, attitude and ^listening skill variables. It is - 
apparent from th^se figures that:, (a) students* performance on the three 
listening subskills is moderately to highly correlated; (b) perform^ce 
of the Us^eninc test is quite highly related to,- or depends fairly^sub- 
stanti^lly upo*f verbal- ability, as measured by the vocabulary test,rand 
(c) there are no significant relationships betweeQstudents rated 'enjoy- 
ment of English classes' and their performance onthe Listening test. 
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TABLE 6 



Correlations among ability, attitude an% listening skill 
variables, foj a sample, of 364 grade 7. 8 and 9 students. 
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'A correlation oi .aw j-^ i<;v^uj.iwv. i - 

14 for significance at p <.01.» Only statistically signifi- 
" cant correlations are reported in this Table. Decimals have 
been omitted for ease of reading. , 
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^ ■ ' SUMMARY 

This report has described, largely in terms of detailed tabular 
data, how students performed on a standardized .test of listening skills, 
the STEP Listening Test. 

In general, the patteiyi of London students' performance on the 
Listening test, paralleled quite, closely that of the standardization or 
normative sample.' It is apparent that performance on thi^ i^istening test 
^s^igily -rS;t6d to general verbal ability, as measured by the vocabulary 
Jest but not^at all to students' rated enjoyment of their English classes. 

unlike many othervskiUs in English, there do not appear to be 
significant sex differences. However, the expected improvement in perfor- 
mance as a function of^grade is apparent, 



^2 j 
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iKterrediate English Evaluation Procect: Student Attitudes. 
Board of Education, London, Ontario, 1973 (mimeo)'. 

Stennett R. G. 5 Isaacs, I,oma. Intermediate English Evaluation Project: 
Survey cf Teaahiers. Board of Education, London, Ontario, 1974 
(mimeo) . 

Males, S., Dickie, L. , Rice, E. 5 Stennett, R. G. Intemediate English 
Evaluation Pro-eat: Cormunity Attitudes. Board of Education, 
London, Ontario, 1973 (mimeo). 

Stennett, R. G. 5 Isaacs, Loma. Intermediate English Eoaluatzon Pro^'ect: 
S-urvej cf Student Achievenent - Over-Jiei). Board of Education, 
London, Ontario, 1974 (mimeo). 
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INTERMEDIATE ENGLISH EVALUATION PROJECT: SPEAKING 

i 



R. G. Stennett, Ph.D. & Loma Isaacs 
Educational Research Services 

Research Report 74-11 



This report is one 'of a series of six which describes in detail 
student attitudes and achievement in major areas of the Intermediate 
English program. The six report|. in turn, represent one major segment 
of^the needs assessment phase of an.ovyall evaluation plan which has 
included prior surveys of the community, faculty and students and a 
special goals-specification project. 

Because of the size and complexity, of the achievement assessment 
phtse of the evaluation project, a 'preface' paper has been prepared 
Ihich gives an over;iew of the project and describes ^the sampling pro- 
cedures, subject .population, testing strategies, program goals evaluated, 
etc, (Stennett S Isaacs, 19^4). The curr^"t^«P°« .^^s been written on 
■■the assumption that the reader will have read this 'preface' paper before 
reading this one. 

This report outlines, in considerable^detail ,, the students sampled, 
the attitudinal and achievement goals selected for evaluation, the tests 
and scales used and the statistical techniques applied. 

A maior limitation of this and other reports in thi% series is 
the absence of clearly-stated standards or expectatzons of student perfor- 
mance against which their aoP.al performance can be evaluated. Really 
appropriate value judgements about tne adequacy of student performance 
r--ir" the development of explicitly-stated, detailed performance stan- . 
da^ds - ke;ed to student age and ability differences - about which there 
is at least a reasonable degree of local consensus. 

The findir.gs provided in this rcpcrt , therefore, represent one 
of the important bases necessary for judgements about whether or not. t..e 
current level of skill ^n speaking is "^dequate". In and of themselves, 
they do not allow such judgements. i 



METHOD 



'^arZ'liK^ 0*" Students 



A total of 540 students were included in the sample used to assess 
speaking skills. As indicated in the 'preface' paper (Stennett i, Isaacs. 
■*19-'41 thi^ group of students is quite representative of all Inteimediate 
level students in terms of age and sex composition. The grade 8 students 
are slightly above, and the grade 10 students slightly below average in 
verbal ability as measured by their performance on the vocabulary subtest 



of the Comprehensive Tests of Basic Skills. They are fairly typical of 
all students in terms of their rated 'Enjoyment of English Classes.' , 



Otcectives Studied and Tests Used 
Attitudes 



Objective: To develop 'in students an enjoyment of speqking and a 
'jillingness to express their opinions and ideas honestly; to develop ^ 
confidence in speaking in public. This objective was assessed by having 
students complete a 6-item, locally developed- attitude scale called 'Self- 
confidence in Speaking ' . 

Skills * / 

Objective : To ha^Je students develop a flexible orA clearly 
a'udicle speaking voice. 

Objective: To rjive studenzs develop zr^ ability to ask pertinent . 
questions and give pertinent answers. 

The degree of student attainment of these objectives was assessed 
by having students participate, one at a time, in a short, structured, 
tape-recorded conversation with an examiner. (See Appendix A.) 

Each student's performance was subsequently 'marked* for correct- 
ness of expression and rated on three simple scalers for: general effec- 
tiveness, pertinence, and quality of speech. (See Appendix B.) 



^est Aarznistratzon 

The oral communication test was administered to students individually 
in an appropriate room of their home school, along with the Gilmore Oral 
Reading Test. The testing ^session, lasting about 10 minutes, was tape- 
recorded.' Other tests of attitude and vocabulary were administered in 
students' regular English classes. 



Test Scoring and Data Analyses 

The oral communication test was scored by having an examiner listen 
to the. tape-recorded conversation twice: first, to count the occurrence of 
seven different errors (Apopiftiix B) and second, to make ratings of Effective- 
ness, Pertinence and (^ujji^ of Speech for both the 'Asking Questions* and 
'Providing -Informatiojr sections of the test. 



The Committee wishes to express its appreciation to the Media Centre for 
their generous cooperation in supplying tape recorders and cassettes. 



Checks on the reliability of the error counts and ratings were 
made by having each of the two examiJiers' score the same set of 25 student 
conversations. The two examiners agreed within one point on the various 
error counts' from "2 to 100 percent of the time (median of 95%) and the 
correlations^calculated between the two sets of six ratings varied from 
."0 to' .96 (median value of . 92) , indicating very adequate reliability 
for the measures used to assess students' speaking skills. 

• ♦ 

Statistical analyses consisted of: (a) calculating descriptive 
statistics and frequency and percentage frequency distributions for all 
variables, separately by grade and grade-sex groupings (b) computing one- 
way analyses of variance rWO\Aj tests across grade and grade-sex groups 
for all variables, and (c) intercorrelating the oral cpiWDunication test 
scores ^ith attitude and verbal ability measures. 

All calculations v^ere done using an laM S^a computer and standard 
statistical programs with the data input on cards which had been kev'punched 
and verified. Initial cor.puter runs were made to edit the data. 



. • ATTITUDE 

The percents of students agreeing with each of the six items making 
up the 'Self-confidence i-n Speaking' scale are presented, by grade and sex, 
in, Table 1. The means of these percent-of- agreement figures, calculated 
across itens, have been plotted by grade, separately for boys and girls, 
m Figure 1 . 

'^^^ 

.Analysis of variance tests rANO\.A) indicate that, with the excep- 
tion of grade 10, boys score significantly higher on this scale than girls, 
and there are no significant differences in students' scores as a function 
of grade. This means that boys are apparently somewhat more self-confident 
than girls when speaking in an audience-type situation dnd that students' 
.-elf-confidence in speaking does not change as they progress through the 
grades. Many students are apparently quite uncomfortable when they have 
to speak in public. * ^ 



^The Committee .Mshes to express its gratitude to Mr. Terry Benbow and Mrs. 
Maryiou Cunningham, two dedicated English teachers, for their con^cien- 
' tjous work on this difficult task. 
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TABLE r 



Percent of students; by grade and sex. agreeing* with' web item 
in the 'Self-confidence in Speaking' scale. m 



Item 
Number 




Percent of Students • 
Acreeinc. by Grade and Sex 


Item 


Sex 


7 


8 


9 


10 


4 


I enjoy taking an active part 
in class discussions. 


M 

F 


87 
78 


88 
82 


83 
79 


• 76 
81 


9** 


I usually don't say anything 
during class discussions be- 
cause rm afraid others might 
laugh at my comments. 


M 

F 


75 
65 


74 
64 


78 
60 


81 

74 


i ■ 

13** 

i ' 

i 


If I know i.I have , to fiv6 a 
speech in class I get so nervous 
I have difficulty getting to 

^ 1 ^^-r^ i-Vi^i mrrVit Kp'ToTP and don * t 
sleep tne mguL uci.wxc o-**^ 

feel like eating breakfast that 
day. 


M 
F 


65 
51 


6-2 
49 


61 
47 


65 
51 


i 

i 19 

t 
i 


I usually feel quite self-con- 
fident when I have to talk in 
front of a group. 


' M 
F 


54 
53 


49 
45 


49 
46 


45 
44 


24 


It doesn't bother me at all to 
give a speech in front of the 

£l^SS . 


M 
F 


36 
^34 


31 
24 


31 
27 


29 
26 


2?* * 


I always feel a bit ner\'Ous 
when I have to speak in class 


M 
F 


45 

1 


43 
26 


44 

30 


44 

32 



*In order to simplify presentation of the data, the scores of 
both students who 'agreed' and 'strongly agreed' with an ite^ 
were added together to calculate tv,e ^^-cent agreement figures 
presented in this table and plotted in Figure 1. 
**In order to 'kgep the figures in this table consistent with the 
positive character of the scale name, the figures for these 
negatively-worded iter«<; are for students who 'disagreed and 
'strongly disagreed' with each. 
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FIGURE 1 flean of percents of students agreeing with 

the SIX Items comprising the 'Self-confidence 
in Speaking' scale ^ by grade and sex. 



• — • Boys 




8 9 10 
Grade 



SKILLS 



The mean nunber of errors of seven different tv-pes students made 
on the oral communication test is presented, by grade, in Table 2. Al- I 
though ^^tudents' performance shows a slight trend toward improvement as \ 
a function of grade level, ANOVA tests indicate that the grade differences: 
are not statistically Significant . ' This suggests that, contrary to what 
might have been expected, students do not show significant improvement 
in the correctness of their oral expression as they progress through the 
Intermediate English program. 



V — ■ 

'The reader should be cautioned that a limitation m the handling of oral 
corjnunication errors, i.e., using the absolute number'of errors rather 
than calculating errors as a 'percentage of words spoken', makes the 
interpretation of this variable somewhat ambiguous. 



TABLE 2 Mean number of errors on the oral coHBUunications test, .by grade. 





Grade 


Type of Error 


7 


8 


9 


10 


• Grammatical Word Error 


.89 


.90 


.52 


.62 


Grammatical Sentence Error 


1.92 


1.66 


1.34 


1 . 16 


Slang • 


.14 


. 10 


.22 


. 14 


i Omnibus Words 


1.59 


1.83 


1.69 


1.87 


Fillers or Cliches 


5.89 


5.52 


5.52 


4.88- 


Repetitions 




.64 


.58 


.35 


! Wrong Words 


.03 


.02 


.00 


■ 00 


1 Total Errors 


11 .25 


10.66 


9.81 


8.98 



The percents of students receiving each of three ratings of the 
Effectiveness, Pertiiffnce and Quality of their oral expression when 
•Asking Questions' are given, by grade, m Table 3(a). Similar -data 
related to students' performance when 'Providing Information' are like- 
wise sumarized in Table 3(b). 



T^E 3 fa) Percents 'of students, by grade, receiving various ratings of Effec- 
' tiveness. Pertinence and Speech Qaality on the 'Asking Questions 
section of the Oral Communications Test. 





Effectiveness 


Pertinence 


Quality of Speech 


Grade 


Grade 




Gr 


ade 




Rating 




'8 


9 


10 




8 


9 


10 


-7 

/ 


8 


9 


10 


3 


72.9 


79.8 


81.9 


"7.0 


42. 1 


41.1 


53.8 


.47.8 


75. 2 


87.6 


81.2 


69.9 


2 


21 .1 


15.5 


15.5 


15.9 


47.4 


46.5 


41.0 


40.7 


15.8 


7.0 


12.0 


17.7 


i 1 


6.0 


4 ." 


2.6 


1 


10.5 


12.4 i S.l 


11.5 


9.0 


5.4 


6.8 


12.4 


( Mean 


2.6" 


2.75 


2.79 


2.70 


2.32 


1 i 

2.29 1 2.49 


2.36 


2.66 


2.82 


2.74 


2. 38 



TABLE 3(b) Percents of students, by grade, receiving Various ratings of Ef fee- • ^ 
tiveness, Pertinence and Speech Quality on He 'Providing Information 
section of the Oral Conmaini cat ions Test. 



Rating 


Effectiveness 


Pertinence 


Quality of Spe'ech 


Grade 


Grade 


Grade 






8 9 


10 


7 


8 


9 


10 




8 - 


9 


10 


5 


29.8 


33.6 1 35. 1 


48." 


16.7 


10.7 


12.7 


21.2 


60.2 


74.0 


55.1 


58;4 


-> 


56 . 5 


58.8 1 52.5 


31.9 


56. 1 


56 . 5 


55.9 


48." 


27.1 


20.6 


28.0 


20.4 


• 1 


13.- 


-.6 j 14.4 


19.5. 


27.3 


32.8 j Si. 4 


30. 1 


;2.8 


• 5.3 


16.9 


21.2 


! Mean 


2. 16 


2.26 i 2.19 


2.29 


1.89 


1.78 1 l.Sl 


1.91 


2.47 


2.69 


2. 38 


2.57 J 



\^i<j\\ tests indicate neither significant grade nor sex differences 
m these ratings of students' oral coininunication. 

Students are apparently sor.e^^hat -ore ^effecti\e* in asking ques- 
tions than in providing information. 

The ^r^ertmence' of their communication is '^so apparently better 
when trev are^ as> ing questions than when they are pro%^iding information. 
Although' the oral carnr.unicat ion test was designed to minimize the influence^ 
of the j:k'^kz of the comnunicatLon on students'' performance, the differ- 
ence in the ratings of 'pertinence' noted above m^', in fact, be related 
to students' knowledge abou^. the appropriate criteria for evaluating a 
book . 



Ratings of the Quality of students' speech when asking questions 
or providing information are sunmarized in Tables 3(a) and 3(b). ANOVA 
tests revealed neither statistically significant sex oi^ grade differences. 
Students apparently show a slightly better quality of expression when 
asking questions, than wh^n providing information. 



- 8 



iKterre'ZcLticKshifs cf 'measures _of vercai, atti-tty, _ 
attiv^de and cral oormuni cation skill. ^ 

Pearson product moment correlations' calculated among the various 
ability, attitude arid oral commanicatiop skill measures are presented in 
Table 4! An examination of these figures indicates that: (a) verbal 
ability, as raeasfired by the vocabulary test, is unrelated to ratings of 
oral communication skill or correctness df expression; (b) there are no 
substantial relationships between students' ratings of their enjoyment of 
English classes or self-confidence in speaking and examiner ratings of the 
qualities of their oral comminication; (c) there are significant, but only 
"modest, relationships among the various ratings of students^ oral conmuni- 
cation. suggesting both that the scales do measure somewhat different 
aspects of performance and that the adequacy of students' communication 
does varv depending upon whether they are asking or answering questions; 
and (d) there are significant, but slight, relationships between ratings 
of students' oral coramunj-cation and their tendency toward incorrect 
expression. This somewhat paradoxical finding is due to the fact that • 
students with the poorest ratings said less and, therefore, made fewer 
errors. 



S 



TABLE 4 Intercorrelations' among measures of verbal ability, attitudes and skill in 
speaking for a sample of 582 grade 7 to grade lO students. 



Variable* 


, 2 


5 


^ r 

4 


5 


6 


7 


8 


9 


10 






-09 
















1. Vocabulai^percentile 
. 2. Enjov-ment of En^^lish classes 




11 


09 


14 




13 


11 






! 3. Self-confidence itC speaking 




















j , 4, Giving information E** 








61 


59 i 


41 


25 


46 


20 


I Sr' Giving information P ^ 










47 1 


36 


50 


40 


37 


i 6. Giving information Q 












41 


27 


69 


21 
1 


j 7. Asking questions E 














62 


64 » 
1 


19' 


1 ^8. Asking questions P < 
















45 ; 
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' 9. Asking questions Q 


















20 


10. Oral communication - total errors 





















*A correlation of .09 is required for statistical significance at p <.0S; 
.12 for significance at p ^.01, Only statistically significant correla- 
tions are reported in this table.- 

►*E = effectiveness; P = pertinence; Q = quality of expression 
Decimals have been omitted for ease of reading. 



The report has described largely in tenns of a series of-'tables 
and figures, how students performed on a. locally-developed test designed 
to measure their skills^ and attitudes in the area of oral communication. 

In general, it appears that the characteristics of students* oral 
communication are well established before- they 6nt€r the Intermediate*^ 
^glish program and change very little as they progress through it. There 
are no substaatial relationships "between students* sex or verbal ability 
and theif skill in 'oral communication. Although boys are apparently 
someuhat more self-confident than girls when they speak. in an audience- 
type sifl^ation, a large number of all students do not share* such self- 
confidence . > 
•* * - • - . - 

Because the tests used to measure stud.ent skill in oral commuhi* 
cat'ron uere locally developed, there are norms or standards against 
uhich students^ performance can be assessed/ ViJiile the ratings of student 
performance in;iicate 'room for improvement*, final judgements of the cur- 
rent adequacy o'f students* spekki-ng skill will probably requrre additional 
review of the tapes of students* conversations by a panel of appropriate^ 
judges . ' ' * ^ ^ . . 
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f r ' APPENDIX A, 

■ ORAL COMMUIil CATION TEST: STRUCTURED INTERVIEW 

MATERIALS NEEDED: Tape Recorder ' 

^ Several Paper Back Books 
Reading paragraphs . * ^ ♦ 

Record blank (Gili^re) 

(PART A - Giving AnsweraT f 

''As "p&rtof your English class, you have already been involved . 
in our English study. Now we are seeing each merfiber of your class on 
an individual basis for this one time only. I'm going to tape this 
session so I don't have to keep writing while we're talking. 

One of the problems that teachers have is deciding which books - 
^to have students read^and study at each grade level. It is difficult 
t'o choose one or two books which everyone in the class will ftnd - 
interesting. By this time you hnve read quite a few books in your 
'English dlasses haven 't you? ^ . ^ 

I. What do you think of thk books you have had to read so far? 

a) Are they the kinds of books you would have chosen for 
the class to read? 

b) ' What other kinds of books would you like to see read in 

classes? » 

t 

' 2. Of all the books or magazines that you've ready in pr out 
of ^ school, which if^ your favorite. If S answers 'I don't 
know' --E says, 'Name one book yoU like: ' ^ 

^ . a) '^Why did you like that particular one? 

b) Cduld you tell me a'hit about it? 

^3. What kinds of books don't you like^^reading? If S answers 
'I don't l^nnw'^ - E ^says, 'Name one book you didn't Uke 
reading. . . "'v' ; 

a) Whu d-n't 'jou like this type of hook?" . ' . 

(NOTE: Do not ask the questions a) and b) if the student has already^ 
' an^jifered them in response to the initial question.) 

(E •should thank the student.) ^ _ , •"■ 

. . f 

ERIC 1^ ^>>'< 
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Appendix A - Continued 



(PART B - Asking Questions) _ * /" 
"Have you read this book?" 

(Answer must^be "NO", if "YES" - select a book S hasn't read.) 

"If this book were \n ^he library and you were . 
if you'd be interested in readirtg it, there would be 
IX to ask about it. We want to^ fi'nd out the type of-nfor^l^ontMt 
students need before tV^y can decide whether or not a book vs worth 
reading. - ' 

I want you 'to ask me 'some questions about this book. Ask me the 
Questions you'luke to have answered%he most.. I won't answer them - 
for you. Vd oust like to kkow the type of infor^tvon you would Uke 
to have. What's your first questvon?" 

(If S only volunteers one or two questions E says,) V 

• • ■ "I'd like you .to ask at least three questions. What else would 
you like to know about the. book?" 

(E should^thank the student.) ^ 

"I would l^lko^ read Pwo paragraphs. . Here is the first one 
Would you read it OT^jj^oud." fC .-. 7) ' ^ ^ 

fF records errors or record blank. If student receive? 10 or 

•.ore' errors giSe hi:" 5 to read. If student receives und.r 10 errors 
give him C - '9 tio read.) 

"Here is the second parag- Would you read it out loud. " 

<E should' tS^ank the student.) 
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STUDENT NUMBER 



giving 
information 



asking 
questions 



EFFECTIVENESS 


PERTINENCE 


QUALITY OF 
SPEECH 















STANDARD ENGLISH (CONVENTIONS) 



grammatical offences - word 

grammatical offences - sentences 
slang or jargon 



omnimbus words, cliches 
fillers 



repetitions 
wrong words 



TOTAL 



ORAL READINGi NATURALNESS 



lERiC 
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APPENDIX B 

JYPES OF ERRORS TABULATED FOR THE ORAL. COMMUNICATION TEST 
AND SCALES USED TO RATE STUDENTS' PERFORMANCE 



STANDARD ENGLISH 

1 . grcormzT 



2. slang 

3. omnibus words 

4. fillers or 

cliches 



5. repetitions 



- word errors, e.g. pronoun errors, double 
negative, adjectives as adverbs 

- sentence errors, e.g. incomplete sentences, 
run on sentences 

- e.g. the guy who ripped off the cops 

- e.g. nice, interesting, good, stuff, okay 

- e.g. y'know, like, see, urn 

generally speaking, to be perfectly 



candid 



- e.g. 



. I read it, yead it, I think I read it 
in grade 6."^ 



6. w^ng words - e.g. I wasn't very convicted by the ending. 

The categories for A (General Effectiveness) and B (Decision Making 
Qualities - Pertinence) are considered independently of the level of lang- 
uage used - not necessarily standard or conventional English. 

'^A. GENERAL EFFECTIVENESS . 

3 Candidates will ask (make) a considerable number of 

clear and concise questions (statements). The 
questions (statements) will be well phrased and 
organized so that there is no ambiguity as to the 
^intended meaning. ^ 

2 - The questions (statements) in this category may, 
be lacking in clarity and organization. Due to a 
deficiency of questions (statements) or a certain 
awkwardness of expression, the listener will, at 
times, find it vague or confusing. 

1 - Responses falling in^this category will contain very 
few, if any, questions (statements). They will be 
confusing and ambiguious and the listener will have 
alifiost no real understanding of the intent. 



- 15 



B. DECISION MAKING QUALITIES (PERTINENCE) 

3 - A considerable number of pertinent questions will be posed 
(statements will be made). The questions (statements) will 
be on topic and will contain a vocabxilary which indicates 
that the respondent has at his command some basic criteria 
on which to base a decision. The questions (statements) 
are likely to be objective in nature and will be related 
specifically to the topic. • 

* 

2 - Some questions will be asked (statements will be made) 
which show some knowledge af the content area. The 
questions (statements) »would tend to be general in- 
nature. Only a qualified decision could be made. 

i - Few, if any, questions >i 1 1 be asked (statements will 
be made). They will indicate a paucity of vocabulary 
and knowledge relating to the content area of books and 
- literature. The questions (statements) may also be 

subjective in nature allowing for no real criteria on 
which to base a decision. , 



4 

QUALITY OF SPEECH 

3 - The speech is loud enough and paced so that it maybe 
readily understood. The'student pronounces words 
correctly and* enunciates clearly. There is expression 
in the voice. 

2 - The speech is difficult to understand in some places 
because it is too soft, not well paced or there is 
some problejn with pronunciation or enunciation. 
There is not much expression in the voice. 

1 - It is very difficult to understand the speech because 
it is too soft, not well paced or the pronunciation or 
enunciation is very poor. There is very little expres- 
sion in the voice. 



* 



16 



INTERMEDIATE ENGCIS^ EVALUATION PROJECT PUBLICATIONS 



Dickie, L. Background and Plan' for the Intemediate English Evaluation 
Project. Board of Education, London, Ontario, 1974 (mimeo). 

Dickie, L. 5 Rice, E. T. . Intemediate English Evaluation Project: Stating 
the Objectives. Board of Education, London, Ontario, 1973 (mimeo) 

Stennett, R. G.,' Dickie, L. , Rice, E. T. , Clift, G. fi Waite, N. 

Intermediate English Evaluation Project: Student Attitudes. 
roard of Education, London, Ontario, 1973 (mimeo), 

Stennett, R. G. 5 Isaacs, Loma. Intemediate English Evaluation Project: 
Survey of Teachers. Board of Education, London, Ontario, 1974 
(mimeo) . 

Males, S., Dickie, L. , Rice^ E. 5 Stennett, R. G. Intem^ediate English 
Evaluation Project: Comnunity Attitudes. Board of Education, 
London, Ontario, 1973 (mimeo). 

Stennett, R. G. 5 Isaacs, Loma. Intemediate English Evaluation Project: 
Survey of Student Achievement - Overviev, Board of Education, 
London, Ontario, 1974 (mimeo). 

Stennett, R. G. 5 Isaacs ,^ Loma. Intemediate English Evaluation Project: 
Reading - Student Attitudes and Achievement. Board of Education, 
London^, Ontario, 1974 (mimeo). 

Stennett, R. G. 5 Isaacs, Loma. Intemediate English Evaluation Project, 
Writing - Student Attitudes and Achievement. Board of Education, 
London'^ Ontario, 1974 (mimeo). 

Stennett, R. G. 5 Isaacs, Loma. Intemediate English Evaluation Project 
Listening. Board of Education, London, Ontario, 1974 (mimeo). 

Stennett, R. G. 5 Isaacs, Loma. Intemediate English Evaluation Project 
'speaking. Board of Education, London, Ontario, 1974 (mimeo). 

Stennett, R. G. 5 Isaacs, Loma. Intemediate English Evaluation Project 
Verbal Creativity. Board of Education, London, Ontario^, 1974 
(mimeo) . 

Stennett, R. G. 5 Isaacs, Loma. Intemediate English Evaluation Project 
Attitudes Revisited. Board of Education, London, Ontario, 1974, 
(mimeo). 

Latimer, R. D. An Overview of the English Language Arts Programs - 

' Intem.ediate Division, City of London Schools. Ministry o'f Educa 
tion, Ontario, 1973 (mimeo). 



1 

INTERMEDIATE ENGLISH EVALUATION PROJECT: VERBAL CREATIVITY 



R. G. Stennett, Ph.D. 5 Loma Isaacs 
Educational Research Services 

Research Report 74-12 



This report ^.s ojne of a series of six which describes in detail 
student attitudes and achievement in major areas of the Intermediate 
English program. The six reports, in turn, represent one major segment 
off the needs assessment phase of an overall evaluation plan which has 
included prior surveys of the community, faculty and students and a 
special goals-specification project. 

Because of the size and complexity of the achievement assessment 
phase of the evaluation project, a* 'preface' paper has been prepared 
uhich gives an overview of the project and describes the sainpling pro- 
cedures, subject population, testing schedules, etc. fStennett 5 Isaacs-, 
19''4) . The current report has been uritten on the assumption that the 
reader will have read this 'preface* paper before reading this one. 

This report outlines the students sanipled, the objectives evaluated, 
the tests and scales used and the statistical techniques employed. 

■A r.ajor limitation of this and other reports in this series is the 
absence of clearly-stated standards or ex^ectazi:^K3 of student performance 
against, which tneir :2a:ual performance can be evaluated. Really approp- 
riate value judgenents about the adequacy of student performance require 
the developnent of explicitly-stated, detailed performance standards - 
keyed to student age and ability differences about uhich there is at . 
least a reasonable degree of local consensus. 

The findings provided in this report., therefore, represent one of 
the important bases necessar>' for judgements about whether or not the 
current development of students' verbal creativity is "adequate". In and 
^1 themselves, they do not allow such judgements. 



A total of 554 stud,ents uas included in the sample used to assess 
verbal creativity. As indicated in the 'preface' paper (Stennett & Isaacs, 
19*^4), this group of students is quite representative of all Intermediate 
level students in terms of age and sex composition, verbal ability and 
rated 'tniovTnent of English Classes'. 

The single, broadly- sta^^ goal selected for evaluation in the 
area of verbal creativity was defined as foflows: 



r 



Zz ie-i'.o-^ the szuder.is' alilith to think h-^-^othetically, creatively 
z>.i '■>: 2>-. otcK-iKdei -sr.r.eT. (Rice £ Dickie, 1973.) 

--=.)r search of the literature revealed that the only 'standardized' 
test which purported to measure the talents encompassed by this goal state- 
ment was the Torrance Tests of Creative Thinking - Ve'rbal Form A (Torrance, 
1966). The author of this test defiftes creativity as '...a process of 
becoming sensitive to problems, deficiencies, gaps in knowledge, missiJig 
elements, disharmonies, and so on; identifying the difficulty; searching 
for solutions, making guesses, or fonnulating hyt)otheses about the deficien- 
cies; resting and retesting these hypotheses and possibly modifying and 
retesting them; and finally communicating the results.' (Torrance, 1966, 
p. 6.) 

Although the Verbal Form A of this test contains seven different 
types of activity, time limitations allowed the administration of only 
two, '.Asking' and 'Unusual Uses'* The Asking activity requires students 
'to look at a simple Ime-drawing and ask questions about it. This test 
gets at the student's '...ability to become sensitive to what is unknowr., 
to gaps in knowledge, because the questions asked must be those that can- 
not be answered by looking at the picture.' 

The K-^rier o- vele-:'ir.t respcrr.ses yields a measure of the student's 
Mieational fZueKO^. ' The nu-ier of different sategories of questions, ^ 
causes or consequences gives a measure of flexibilit}.. The statzsfi.aa. 
i--.freoueKa-. of the questions, causes or consequences or the fcAlent to which 
the student's responses represent a mental leap or departure from the 
obvious yields a measure of original'.ty. 

Tne Unusual Uses activity requires the student to think of as many 
different uses as he can for cardboard boxes. This activity tests students' 
ability to free ther.selves of a well-established set, i.e., boxes are con- ' 
tamers, and think divergently. Students' responses are evaluated for 
•ZueKC-, '".exi'ci\it<- axji ori-ciKdlif^i in the same fashion as described above 
^For the Asking activity. 



The Torrance Test was administered, along with Vocabulary-, Attitude 
and Reading tests, to students in their regular classroom groups (as part 
of Batterv- II, Stennett c, Isaacs, 19:'4) in the manner suggested by the 
author, I'.e. , the 'non-test' character of the ejcercise was explained and 
the tir.e linits rigidly observed.' This test was given priur to the othet 
nore typical tests to encourage a 'freer' response mode from students. 
Students were allowed five minutes, for the Asking activity and ten -minutes 
for Unusual Uses . 



Zesz 3?zriK^' and izza r^.j^'^^sia 

The Torrance tests were scored, using the directions and standards 
proMded by their author, dv two experienced, specidiiy-trained, English 
teachers.-' To check the reliability of the scoring, the two examiners 
scored a random sample of 24 student records independently and the result- 
ing 24 sets of scores were correlated. The correlation coefficients, 
presented in Table 1, indicate ver>- high mter-scorer reliability of the 
order that the author indicates is possible using his standards and scor- 
ing system. 

• 

TABLE 1 ^ Pearson product moment correlations between 

the Torrance Tests of Creative Thinking scores 
of 24 students developed independently by two 
examiners. 



i 


Act i\ ity 


Scale 




- -Asking 


5 - UiiuSual Uses 


F luenc%' 




.99 


■f ■ 

: 1 00 ' 


' Flexibility 




,95 


.91 


Originality 




.96 


.94 



Since orl> t^o of the seven Activities -.ere adrjinistered, it was 
not possible to refer Lor.don students* raw scores, to the test publishers' 
norr.ative data to obtain percentile scores.^ 

All data for this sainple of students were punched into data cards, 
verified and subsequently edited by cor.puter. The major analyses, done 
using standard statistical' con:puter programs, consisted of: 

(a^ calculating means and standard deviations and preparing 
frequency and percentage frequency distributions for all variables, 
separately for grade and grade-sex groupings of students; 

(bj calculating one-way analyses of variance (.^SOVA) across grade 
and grade-sex groups for all major scores and subscores, and 



-The Committee would like to express its gratitude to Mr. Terr>' Renbow and 
Mrs. MarXlou Cunninghar: for their conscientious and dedicated work on this 
phase of the project. 

In correspondence with Dr. Torrance it was d;scovered that separate grade- 
level 'norms* for each activity were not available and could not be supp- 
- lied "for \erbal Form K of this' test. Limited data for Verbal Form B were 
provided, and the authors thank Dr. Torrance for the considerable work 
involved in providing this information. 
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(c) intercorrclatmA all rr.ajoAs cores and subscores. Because not 
all students took the same fbrm of all W tests, correlations v.ere cal- 
culated using only students ^nroled in giudes ^, 8 and 9. 



Mean scores for students are provided in Table 2 separately by 
grade and sex-, for each of the three dimensions (fluency, flexibility and 
originality) for Activity 1 - Asking Questions, and Activity 5 - Unusual 
Uses. A comparison of the mean, scoref of London grade 8, 9 ^d 10 students 
on \eTbal Form A v%ith a similarly composed 'norm' group on \erbal Form B 
can be made by examining the data of Table 3. 

TABLE 2 Mean scoi1%, by grade and sex^ on the Fluency, Flexibility 
and Originality Scales for Activities 1 and 5 of Verbal 
Form A of the Torrance Tests of Creative Thinking for a 
* sample of 508 students enroled in grades " to 10 inclusive. 



3 



'X 

< 



I - Flexibility 



6. 1 



6.3 



6.0 



6.4 



4^ 



5.8 



6.1 



6.4 



I - Originality 'i 



4.6 



7.3 



7.4 



I 



6.2 



8.4 



5.4 



7.2 



Fluency 



20.9 



22. 2 



19.6 



26.5 



21, 1 



22.2 
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... T . 23.6 ■ 21.6 1 21.0 


22.8 1 


i o 

~ ; \ - Flexibility 

X i 


M 8.7 ■ 10.0 i ' 8.6 


9.4 1 


F I 10.6 ! 9.6 1 10.0 


10.3 j 


? I 
T ' 9.6 1 9.8 ' 


9.3 


9.9 1 


C \ ■ ■ " 

~" 1 V - Originality 

i 


f • 1 

M ; 5.9 


8.8 


7.8 


7.9 


P ' 9.6 


7.3 


1.1 


8". 4 


T 


7.4 


5.8 


6.9 


7.0 


'■ 

\ Number of Cases 


M 


71 


70 


56 


47 


; F 


67 


72 


66 


59 


T 


138 


142 


122 


106 


* M = male, F = female, T = all students 

Hi 



6.8 



6.6 



6.' 



9.5 



8.7 



8.0 i 9.0 



20.6 



24.6 



Scale 


Grade 


• 

Group* , 7 


8 9 


10 


' I - Fluency 


M * \ 8.0 


10.2 10.3 


10.9 


F 9.9 


9.9 ■ 10.7 


10.6 


1— * 1 

T - 8.9 


10.0 10.5 

i y 1 


10.7 



5 



i 



TABLE 3 Mean 'scores for grade 8, 9 and 10 London students on 

Verbal Form A and for the 'ngrmative' sample on Verbal 
Form B. 



Scale 


Activity 


1 - Asking 


5 - Unusual Uses 


London 


Norm 


London 


Norm 


Fluency 


10.59 


11.15 


21.78 


17.94 


Flexibility 


6.36 


6.94 


9.67 


8.34 


Originality 


7.98 


4.77 


7.97 


lo'.77 



.ANOVA tests revealed no statistically significant sex differences 
at any grade level on any of the dimensions of either Activity 1 or 5. 
In fact, the only statistically significant differences are betv^een grade 
^ and 9 and/or 10 students for all three subscales of Activity 1. The 
size of the differences in absolute terms is, however, relatively small 
(Table 2). 

The data of Table 5 indicate that the level and patterning of 
London grade 8, 9 and 10 students'* responses is quite similar to that of 
the 'norm* group ... London students performing slightly better on some 
dimensions and slightly worse on others. Because London students took 
\erbal Form A of the Torrance test and normative data are available only 
for the parallel', but not necessarily equivalent. Verbal Form B, no sta- 
tistical tests for differences 'between the two groups were made. 



SKterrelationskipc of VercaV Ahzlzty y 
^.ttitude and Verbal Creativity Measures 

Pearson product-moment correlations, calculated among a series of 
ability, attitude and verbal creativity measures are displayed m Table 4. 
It is apparent from these data that: (a) for both 'Asking' and 'Unusual 
Uses' activities, students' scores on the fluency, f l^Jcibi lity, and origin- 
ality dimensions are moderately correlated (b) students* performance on 
the 'Asking' activity is only modestly related to their performance on 
'Unusual Uses'. (c) students' performance on the verbal creativity tests 
shows a significant but minor relationship to their rated enjoyment of 
reading, writing and self-confidence in speaking and to their verbal 
ability and rea4ing skill. This finding^of relative independence of 
verbal creativity and verbal abi]Tty simply confirm3 prior findings by 
Torrance and other investigators working in the are^ of creativity. 
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tABLE 4 Correlations among Ability, Attitude and Verbal Creativity 
measures for a sample* of 4,02 grade 7, 8 and 9 students. 



V arxaDie 


Attitude 


Askin 




Unusual 
Uses 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


1, Vocabulary 


81 


34 




17 


23 


26 


17 




17 




2. STEP II Reading 




37 




16 


23 


23 


18 




19 




3. Enjoyment ►Of Reading 






26 




15- 


19 




12 


13 




4. Enjoyment of Writing 








17 ! 


13 


12 


12 


22 


17 


11 


5. Self-confidence in Speaking 










11 




19 

■ ' 


15 


20 


13 


6. Asking - Fluency 












77 ' 


71 I 


49 


45 


40 


7. Asking - Flexibility 














r 

46; 


37 


35 


34 


8. Asking - Originality 
















40 

— : 


38 


29 


9, Unusual Uses - Fluency 


















67 


69 


10, Unusual Uses - Flexibility 




















66 


11. Unusual Us^s - Originality 














■ 









*A correlation of .10 is required for significance at p <,05, 
.13 for significance at p <.01. Only statistically signifi- 
cant correlations are reported^in this Table. Decimals have 
beep omitted for ease of reading. 



This report has described studen/s^ performance on measures of 
-verbal creativity and the relationship of this performance t5 measures of 
their verbal ability, realling skill, and attitudes tovfard three aspects of 
the English program. 

The level and patterning of London students* performance on the 
creativity tests follows quit^ closely^that of the 'norm' group. N<5 signif 
icaTit sex differences and only minor grade trends Were evident -in students' 
responses to the Torrance Tests of 'Creative Thinking. 

- ^ ' 

The unavailability of really appropriate normative data make assess 
ment of London students' perfoi^ance in the area of verbal creativity \ 
difficult. ' * 

One ca'n obfain a more concrete impression by trying the test one- 
self and then reviev^ing the actual responses of a sample of stiHents. 
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This report is one of a series of six which describes in detail 
student attitudes .and achievement in major areas of .the Intermediate ^ 
English program. The six reports, in turn, represent one toajor Segment 
of the .needs assessment phase of an overall evaluation plan which has 
include^d'prior surveys of the community, faculty and students and a 
speVial goals-specif jcation project. « 
\ ^ * 

Because of the size and complexity of tl|p 'achievement assessment 
phase of the evaluation project, a 'preface' , paper has been prepared which 
gives an overview of the projept and describes the sampling procedures, 
^subject population, tests used, etc. (Stennett 5 Isaacs, 1974). The 
current report ha^ been written on the assumption that the reader will ^ 
have read the 'preface' jpaper before reading this one. 

This report summarizes the results of all the attitude measures 
used, describes the interrelationships among them and their relationships 
to other measures of ability and achievement. In addition, students' 
?nAral attitudes toward English are compared with their attitudes toward 
.academic subjects. The variation in student attitudes as a function 
oi" ^ U dent"Sex teapher-sex interaction is also described. Finally, the 
.results of the findings of this study are compared with those obtained in 
the original surve^-^^of student attitudes (Stenoett, Dickie, et al., 19^3) 

Whis original survey involved admijiistering a UOO-item test, ^ 
composed of several types of items, designed to assess student attitudes 
^toward various facets of ' the English program. The results indicated 
fairly consistent sex differences, girls generally ^being more positive^ 
than boys toward most gspiects of the program, and fairly consistent grade 
triids, secondary Students genera,lly being less positive than elementary 
students- A trend ^for , girls to show a more pronounced elementary-to- 
' secondary decrease Tn the positiveness of their attitudes toward -English 
"^Than boys waS 'also noted. * . ^ 

Because of certain limitations in. the original study and the need 
to relate student attitudes f^oTlheir achievement^, a 40-item attitude sur- 
vey was developed from the original lOO-item test and administered to all 
'students participating in the current project. . • ' 

The-reader should be cautioned that this study is cross-sectional 
> rather* than longitudinal in nature. This' means tha? when change^ in 
student attitudes are' reported^as a function of gr$cie level, different 
groups 9f sti^dents are -involved. The results, therefore, do not necess- 
^ arily represent what one might obtain if. the same studeats were tested in 

, 10J7i4 
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each of four consecutive years. Although the results of the cross- 
sectional approach at the elementary level (grades 7 and 8) would probably 
be fairly comparable to those of a longitudinal approach, the differential 
attrition of students in grades 9 and 10 and the addition of proportionally 
more students from other school systems make the comparability of cross- 
sectional and longitudinal approaches at this level. much less adequate. 

An additional caution is necessary with respect to comparisons of 
the findings of the original and current attitude studies. Althougb the 
findings are generally similar, differences in sampling procedures, timing 
of testing, th6 tests themselves and the methods of administration largely 
preclude inferring that (Mfferences in stu4fents' scores between the two 
studies represent any underlying change in attitudes during the nine months 
IJfetween the two studies. 



tfETHOD 

Subjects . J 

The subjects for this study were 2,684 students, about 600 to 700 
in each grade from 7 to 10. Within elementary and secondary panels, ^the 
samples are quite representative of their respective population in terms 
of grade and sex composition. (See Stennett & Isaacs, 1974 for details 
and sampling procedures.) The original study involved 1,247 students, * 
with about 250 to 370 per^grade level. (See Stennett, Dickie, et al., 
1973 for details and, sampling procedures.) 

Although the six major attitude scales were administered to all 
students, various achievement and other tests were admini *^tpred to differ- 
ent comparable subsamples of students containing about 525 students, 100 
to 150 per grade level. To avoid- duplication the nuitibers of students (Ns) 
involved in each analysis will be given with the results rather than in ^ 
this secti'^r. . 



Tests ^ 

^ A general description of all the tests used is provided in the 
'preface' papeV (Stennett 5 Isaacs, 1974) and additional detail is given 
in the five other rej^rts in this series. A copy of the test used to 
allow students to ra^s^.eir liking for, and difficulty with, five differ- 
ent academic subjects is given in Appendix*A. 

Five of the six attitude scales for this study were devejioped, as 
a resuii of detailed statistical analysis, from items contained m the 
original 100-item, attitude survey. The sixth scale, 'Self-conf idence in 
Speaking, was adapted from a scale developed for another project (Gardner 
5 Smythe, 1974). Although the items in three of the current attitude 
scales are identical in wording and re^^ponse format to those of the 
ordinal :>tudy, two of the current scales used slightly different wording 
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and format. The number and arrangement of the items of course, quite 

different in the two studies. ^ - * 

» r 

Test Administration 

In the original study the attitude scales were administered by 
either a princjipal, vice-principal or homeroom teacher. In the current 
study, all tests were administered by a team of six specially trained 
teachers in students* regularly-scheduled English classes with the assis- 
tance of the cT^ssrocni teacher. A special effort was made to encourage 
students to express their opinions freely and frankly . _ 

In the original study, students were tested in May, 1973; in the 
current study, the tests were administered in February and March, 1974. 



Data Handling and Presentation 

Students made their responses to most of the attitude, ability 
and achievement tests on machine-scorable answer sheg^ts. Their responses 
to all other tests were coded, keypunched into cards and verified. All 
student responses to all tests were ultimately transferred to data cards 
for scoring, tabulation and analysis by computer. / 

In tabulating the results of the attitude scales , a ^'reverse** 
scoring key was used for ilegatively worded items and students* responses 
are reported largely in terms of the percents of students ^'agreeing** 
with.tlie various items. Thesei percent agreement figures are reported in 
tabular form for eac^t. item in each of the scales, separately by grade and 
sex. Means of the percent agreement figures across the items in each 
scale are plotted, separately by grade and sex, in a series of figures. 

Tests of sex differences and grade trends were made using one-way 
analyses of variance (ANOVA) and a posteriori- Scheff^ t.ests. An examination 
of possible teacher-sex, student-sex, elementary-secondary attitude inter- 
actions was done using the same techixiques . ^ 

Interrelationships of student attitude, ability and achievement 
scores were assessed by calculating Pearson product-moment correlations 
among these s<|a;;^bles for the various subsamples of students who received 
different combinations of tests. 

In order to make this report as concise as possible, most of thl 
detailed finding*^ ^re reported primarily in terms of tables and Figures 
which, it is hoped, will be largely self-explanatory. General patterns 
and trends are noted in the text where appropriate. 

5 

: — ; T 

^Although 2- and 3-way ANOVA tests would have been more appropriate, time 
and computer program limitations dictated the use of the simpler tech- 
niques described. 
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« RESULTS ' 

Sex Differences and Grade Trends 

The percents of students, by grade and sex, agreeing with each 
item making up each of the six attitude scales (Enjoyment of English 
Classes, ^Usefulness of Grammar, Enjoyment of Writing, Enjoyment of Read- 
ing, Application of English Skills and Self-confidence in Speaking) are 
presented in Tables 1 to 6, Means <5f the, percent agreement figures for 
each of the six scales are plotted, by grade and sex, in Figures 1 to 6. 
As found in the original _siudy, girls* are generally somewhat more positiv( 
than boys. and, with the exception of the scale measuring Enjoyment ot 
English classes, secondary students , especially boys, are less positive 
than elementary students. 

Boys express somewhat more self-confidence in speaking than girls 
at all grades with little change over the grade 7 to 10 interval.. 



TABLE 1 Percent of students, by grade and sex, agreeing* with the six items 
making up the Enjoyment of English Classes scale. 







Percent 


of Students 




Item 




Agreeing, by Grade and 


Sex 


Number 


Item 


Sex 


7 


8 


9 


10 






M 


40* 


36 


55 


45 


7 


English classes are fun. 


F 


51 


53 


- 65 


59 


11 


I look forward to going to 


M 


31 


21 


45 


37 




English classes each day. 


F 


39 . 


41 


54 


49 




I enjoy English classes. 


M 


Ad ■ 


-55 


59 


50 


15 


F 


53 • 


60 


69 


68 


20 


^ I feel that the English class- 


M 


43 


34 


57 ' 


45 


room is a happy place. 


F 


45 


49 


59 


57 


23 


I find that most of my English 


M . 


51 


43 


56 


51 


classes are interesting. 


F 


59 


58 


68 


64 • 


28 


I would rather attend English 


M 


20 


11 


30 


25 


class than most other classes. 


■ F 


28 


,31 


43 ° 


44 



*In order to simplify presentation of the data, the scores of both 
students who 'agreed^ and 'strongly agreed' with ah item were added 
together to calculate the percent agreement figures presented in 
-Tables 1 to 6 and Figures 1 to 6. 
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FIGURE 1 Mean of percents of students agreeing 
with the six items comprising the 
Enjoyment of English Classes scale, 
by grade and sex. 
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TABLE 2 Percent of students, by grade and sex, agreeing with the five items 
making up the Usefulness of Grammar scale. 



Item 
Number 




Percent of Students 
Agreeing, by Grade and Sex 


Item 


Sex 


7 


8 


9 


10 


2 


The study of grammar helps my 
writing. 


M 

c 
r 


55 

D 0 


51 
69 


68 
80 


68 
82 


12 


The grammar i s*Tiay ib 
necessary. ^ 


M 

F 


87 
83 


74 
83 


71 
78 

( 1 


63 
76 


14 


I believe that people who 
1 use poor grammar are poorly 
i educated. 


M 

'F 


37 
37 


32 ! 32 

33 j 33 

1 

\ , 


22 
30 


22 


Punctuation rules are good to 
know. 


M 

F 


89 
92 


89 j 88 
93 1 91 

. -4 ■ 


82 
90 


30 


I try to apply the grammar 
rules that I have learned 
when I am writing. 


M 

F 


81 
85 


73 
86 


1 

: 79 
I 85 

1 


75 
81 



FIGURE 2 Mean of percents of students agree- 
ing with the five items comprising the , 
iTsefulness of Grammar scale, by grade 
and' sex. * 
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TABLE 3 Percent of siudents, by grade and sex, agreeing with each item 
in the 'Enjoyment of Writing' scale. 



L 



r - 
1 

i Item 
t Number 


Item 


Percent of Students 
Apreeinp. by Grade and Sex 


Sex 


7 


8 


9 


10 


i 


MeJDory work is worthwhile. 


M 
F 


64 
64 


54 
60 


44 
49 


36 
42 

■ i 


8 


I enjoy writing short stories. 


M 

F 


^ 73 
i 69 

4 


1 62 1 60 
' 75 i 60 
i i 


43 1 
56 i 
i i 


; 18 

1- 


I like writing poetr>'. 


M 45 41 27 23 

F 65 58 ' 49 53 

: \ i 1 -J 



FIGURE 3 Mean of percents of students agree- 
ing with the three items comprising 
the Enjoyment of Writing scale, by 
grade and sex. 
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TABLE 4 Percent Cf students, by grade and sex, agreeing with 
in the "Enjoyroent of Reading' scale. 







Percent 


of Students 




. Item 




Agreeing , by Grade and 


Sex 


Number 


Item 


Sex 


7 


8 


9 > 


10 




I read books apart from those 


M 


80 


82 


75 


72 


1 


that are required reading for 
classes . 


F 


83 


91 


88 


89 


6 


I have recommended a book to 
a friend. 


M 

F 


84 


91 


A'8 
92 


73 
92 




Once I have begun a book I 


M 


62 


52 


57 


51 


16 

1 

! 


often finish it within a few- 
days . 


F 


63 


67 


74 


1 


i n 


I have re-read a favourite 
book . 


M 
F 


77 
86 


87 


65 
72 


56 
75 


25 


I enjoy reading novels of 
movies 1 have enjoyed. 


M 

, F 


76 
80 


68 
86 


68 
82 


63 
83 




When I have extra time in 


M 


56 


53 


33 


30 


29 


class, I often read a 
library book. 


F 




59 ' 


"45 


39 



FIGURE 4 Mean of percents of students agreeing v%ith 
f the six Items comprising the Enjoyment of 
Reading scale, by grade and sex. 
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FABLt 5 Percent of students, by grade and sex, agreeing with each 
the 'Application of English Skills' scale. 





1 

( 

1 Item 
! Number 




Percent of Students 
Agreeing, by Grade and 


1 

Sex 


Item 


Sex 


7 


8 


9 


10 


p ^ 

\ 5 

j 


I look up unfamiliar words in 
a dictionary when I come 
across them in a book. 


M 


56 
6? 




56 
64 

■ 


51 
62 


44 
56 




wK<^n T wrii-o TinfA^ f o 3 £r i end . 
I use complete sentences. 


M 

F 

^ 


57 
59 


45 


47 
54 


37 
51 


17 

1 




Before I hand in a social 
studies or science report, I 
check the spelling of words 
which I think I may have 
spelled incorrectly. 


■■ 

' M 


66 
74 


58 

■ 75 


1 57 
i 78 

i 
1 

i 


57 
75 


26 


I usually check whatever I 
write to make sure that there 
are no mistakes in spelling, 
grammar or punctuation. 


M 
F 


62 
73 


; 56 

\ 80 

1 


; 55 

\ 78 

1 
1 


54 
80 



FIGURE 5 Mean percents of students agreeing with 
the four items comprising the Applica- 
tion of English Skills scale, by grade 
and sex. 



OO Girls 




^ t -1 I i L_ 

7 8 9 10 
Grade 



- 10 



FABLE 6 Percent of students, by grade and sex, agreeing with 
in the ' Self -con fi device in Speaking' scale. 



I tern 
Number 




Percent of Students 
Acreeine. by Grade and Sex 


Item 


Sex 


7 


8 


9 


10 


4 


=^^^^^^=^^^^^^^^ 

I enjoy taking an active part 
in class discussions. 


M 

F 


87 
78 


88 
82 


83 

79 


76 
81 


9* 


S usually don't say anything 
during class discussions be- 
cause 'I'm afraid others might 
laugh at my comments. 


M 

F 


75 
65 


74. 
64 


78. 
60 


81 

74 




If I know I have to give a 
speech in class I get so nervous 
I have difficulty getting to 
sleep the nights before and don't 
feel like eating breakfast that 
day. 


F 


65 
51 


62 
49 


61 
47 


65 
51 


[ ' 

i 


I usually feel quite self-con- 
fident when I have to talk in 
front of a group. 


M 
F 


54 
53 


49 
45 


49 
46 


45 
44 


24 




It doesn't bother me at all to 
give a speech in frortt of the 
class . 


M 

F 


36 
34 


31 
24 


31 

27 


29 
26 


27* 


I always feel a bit nervous 
when I have to speak in class 


M 

F 


45 

32 


43 

26 


44 
30 


44 
•32 



Mn order to keep the figures in 
positive character of the scale 
negatively-worded items are for 
^strongly disagreed* with each. 



this table consistent with the 
name, the figures for these 
students who 'disagreed* and 
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FIGURE 6 Mean of percents of students agreeing with 

the six items comprising the 'Self-confidence 
in'Speaking' scale, by grade and sex. 
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KterrelatioKs of Attitude arj Liking 
Enalish Fatings 



and 



Table 7 gives the correlations among the 6 attitude scales and 
liking and difficulty of English ratings for a sample of 582 grade 7 to 
10 students . ^ 

With the exception of the self-confidence-in-speaking scale, all 
of the correlations, though statistically significant, are modest in size, 
ranging from -.11 to .62. This finding tends to confirm the. fact that 
the various scales do measure relatively distinct aspects of students' 
attitude^s toward English and also that students who are positive toward 
one aspect of th^ program tend, to a limited degree, to be positive toward 
other aspects of it. ' , 

The substantial correlation (.62) between students' rated Enjoy- 
ment of English and their scores on the^Enjoyment of English classes scale 
IS not surprising -because of the overlap in scale content. The fact that 
students' ratings of the difficulty of English correlate negatively with 
their scores on the other attitude scales suggests that at least part of 
students' negative attitude toward English is associated with their per- 
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ception of it as a difficult subject. Students who find English difficult 
tend nqt to like it.. ..and this, as will be shown in a later section of 
this report/ is also true for other academic subjects. 



TABLE 7 Intercorrelations of English Attitude and Liking and 

Difficulty of English scores for a sample of S82 students 
enrolled in grades 7 to 10 inclusive; 



Attitude Scale* 


2 


3 


4 


5 


6 


7 


8 


1, Enjoyment of Reading 


37 


24 


22 


-20. 


19 


38 




2. Enjoyment of Writing 




37 


- 34 


-20 


28 


31 


11 


3. Enjoyment of English Classes 






62 


-33 


32 


33 


11 


4. Liking of English 








-52 


24 


20 


14 


5. Difficulty of Enfjlish 










-14 


-11 


-26 


6. Usefulness of Grammar 












43 


09 


7. Application of English Skills 
















8. Self-confidence in Speaking 

















*A correlation of .09 is required for significance at p <.05; .12 
for significance at p <.01. Only statistically significant correla- 
tions are reported in this table. Decimal places have been omitted 
for ease of reading. ^ 



* Original and "Z'jLTver^. Study Findings . r 

Figures 7 to 11 show plots of the.means of perceif agreement values, 
separately by grade and sex, for the five attitude scales administered in 
both studies.^ A review of these Figures reveals the following paUems: 
(a) girls are without exception more positive than boys at all grade Uyfils 
in both studies; (b) an elementary to secondary decrease in positiveness 



^For the Enjoyment of English Classes, Usefulness of Grammar and Enjoyment 
of Writing scales, data for the same items (which involved the same res- 
ponse format) are reported. For the Enjoyment of Reading scale, data from 
th^ame items are reported but the student response format used was dif- 
ferent (3-point vs 4-point scale). For the Application of English Skills 
scale^ three of the four items were the same, but the response format was 
different in the original and current studies. The Self-confidence in 
Speaking scale was not included in the original study and there are, . 
therefore, no comparisons poss^ible. 
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is apparent with respect to Enjoyments of Writing, Application of English' 
Skills, Enjoyment of Readin:g and, to a lesser extent. Usefulness of 
Grammar in both studies; (c).a tendency for students' Enjoyment of Eng- 
lish Classes to increase over the elementary to secondary transition, 
especially in the case of boys--a tendency more marked in the current 
study than in the original 'one; (d) students'^ attitudes as measured in 
February, 1974 are somewhat ^more positive -than when measured in May, 1973; 
(e) the increasingly negative attitudes of girls at the secondary level 
apparent in the results of the original study is not apparent in the / 
Current one and, in fact, what was a- rated decrease in Enjoyment of 
English classes at the secondary level im 1973 has changed to a fairly 
substantial increaTe in enjoyment in 1974 for the girl%; (f) for both 
the' Application of English Skillsz-^lmd Enjoyment of Writing scales, the ^ 
decrease in positiveness ov6r the grade 7 to 10 interval is rfiuch more 
marked in the current than in the., original study. 



FIGURE 7 



Mean of percents of students agreeing with the three 
items making^ up the Enjoyment of Writing Scale, by 
grade and sex, for the originaJ '-(May , 1973) and cur- 
rent- (Feb, f974) studies. I' * } 
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As mentioned earlier in this report, differences iji the .test items, 
response format, sampling of students and time of test administration 
preclude making really valid comparisons between the findings of the two \ 
studies. It seems quite clear, however, that the general nature and pat- 
terning of results of the two studies are quite similar an4 this, in turn, 
permits additional confidence in the findings. 



FidURE 8 '-Mean of percents of students agree iT\2>ith. the. four 
items making the Application of. E^lish Skills 
scale, by grade and sex., for 'the original (May, 1973) 
and current (February, 1974) ^studies., 
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FIGURE 9 



Mean^percents of students agreeing with the six items 
raakijci^p the Enjoyment of Reading scale, by grade and 
sex, for the original (May, 1973) and current (February , 
1974) stud^ies. 
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FIGURE 10 Mean of percents of students agreeing with the five 
items making up the Usefulness of Grammar scale, by 
grade and sex, for the original (May, 1973) and cur- 
-rent (February, 1974) studies. 
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FIGURE 11 Mean of percents of students agreeing with the six 
items making up the Enjoyment of English Classes 
scale, by grade and sex, for the original (May, 1973) 
and current (February, 1974) studies. 
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Teaoher-sex, Student-sex, Elementary-Secondary Interactions 

It was noted in the original study that girls' attitudes tended 
to change more dramaticarHy over the elementary to secondary transition 
than did those of the boys. Although no ready explanation for this find- 
ing was apparent, it was known that the^ percentage of English teachers 
who are women is substantially higher in the secondary panel. This led 
to the hypothesis that students* attitudes toward English mi-ght vary as 
a function of both their own and their teachers* sex. 

In order to test this hypothesis the data for students were divided 
into eight groups in terms of-whether the- students were enrolled at elemen- 
tary or secondary level, whether they were a boy or a girl and whether or 
not their English teacher was a man or a woman. One-way ANOVA tests were^ 
then conducted separately for each of the six attitude scale scores across 
these eight groups and appropriate a posteriori Scheff6 tests done. Sta- 
tistically significant^^ii^lts were obtained on only 2 of the 6 scales, 
Enjoyment of English classes and Usefulness of Grammar. 

Plots of the mean raw scores for the various groups of students 
on th^se two scales are provided in Figure 12.^ As expected, girls* 
attitudes are more positive than those of the boys and the elementary- 
o^secondary differenced (in different directions) are apparent as they were 
in the earlier analyses of these two scales. 

There ar^" no statistically significant differences in students' 
rated Enjt)yment of English classes as a function of teacher sex at the 
elementary level. At the secondary level, however, Aoys wh9 have a male 
teacher are significantly more positive in their rated enjoyment of English 
classes than those who have a female teacher. Secondary girls who have a 
male teacher are mQ3t positive, whereas secondary boys with a female 
teacher are least positive. 

There is also a slight trend, evident in the results for the 
^Usefulness of Grammar scale, for boys with a female English teacher to 
be the least positive in their attitudes. . 

The reader should be cautioned that, while the results of this • 
analysis are interesting , ^they are at best tentative. It was not possible, 
for example; to eliminate the effects of other variables ,« such as the level . 
of stutients* 3,econdary program, which might indirectly produce the results 
obtained. 



Students Liking For, and Perceived 
difficulty of. Five Academic Subjects 

^ • 

One of the /limitations of" the original attitude survey was that, 
although it did assess students* liking and enjoyment of English, the 



^B^cause of the way the students* tests were scored for this analysis/ a 
low scbre means a moreyositive attitude. 
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asses^Q£fitj?-as done only in terms of students' responses to items dealing 
with English. This strategy, though useful, does not provide sufficient 
reference points in terms of which , students ' attitudes can be evaluated. 
To overcome this limitation, students in the current stUdy were asked to 
rate their 'liking' for, and 'difficulty' with, four otrier academic sub- 
jects, as. well as English. In this way, it is possible ]to assess student 
attitudes toward English relative to their attitudes toward other subjects. 

The percents of students who 'strongly agreed* or 'agreed' with . 
each of the statements contained in the Liking and Difficulty test 
(Appendix A) are plotted, by grade level, in Figure 13. In general a 
majority of students (50-70%) express a liking for all subjects rated and 
a minority (10-25%) rate them as difficult. Kith the exception of English, 
students' ratings at the secondary level are slightly less positive than 
those of elementar)-, students. There are slight trends for secondary stu- 
dents to rate Mathematics, Science and History as more difficult than do 
elementar>- students. There is little difference'in the difficulty ratings 
given English and Geography by elementary and secondary students. Overall, 
Mathematics and English are rated as slightly more difficult than the 
other subjects. 

Although there are ver>' different patterns across the grade levels 
in students' rated liking of the various subjects, there do not appear to 
be marked overall differences in the degree to which they rate the subjects, 
i.e., in general, intennedi ate students as a group do not appear to preter 
one subject greatly over another. 

' It IS also apparent from the curves plotted in Figure 13 that 
students' Ukmg for a subject is inversely related to the difficulty they 
have with it. This observation is supported by the inter-correlations 
amone the 10 liking and difficulty ratings reported in Table 8. The 
Trrelauons of liking and difficulty ratings ^itnin subjects are remark- 
ably similar, varying from -.52 to -.49. 

Correlations of liking ratings afnong the five academic subjects 
are statistically significant but small, ranging -from .12 to 2:, with a 
median of 1". Correlations of difficulty ratings among the five academic 
subjects are similar in significance and size, ranging from .08 to .34 
with a median of .19. These sets of correlations indicate a very slight 
tendency for students who like one subject to also like the others and 
conversely, for students who find one^bject difficult to find the others 
difficult. The size of the correlations, however, indicates that, for any 
particular student, there can be wide variations in both his liking and 
difficulty ratings across the five academic subjects. 

Of the 20 correlations of liking and difficulty ratings acrcss 
subjects, onlv 9 are statistically significant and these are all small 
and negative,' ranging from -.09 to -.23. The pattern of these relation- 
ships appears largely to reflect the general tendency for liking and 
difficulty ratings to be inversely related. 



/ 

FmuRE 13 Percents of students, by grade level, who 'strongly agree' or 'agree 
^ It^rftatements indicating 'liking' and 'difficulty' of five academe 

subjects. 
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lABLE 8 Intercorrelations of 582 Grade 7 to 10 students Liking and Diffi 
culty Ratings of Five Academic Subjects. 



Rating Scale* 


2 


3 


4 


5 


6 


7 


8 


9 


10 


1 . Liking of English 


14 


.•19 


13 


15! 




-14 








2. Liking of Geography 




14 


24 


f 

19 1 


-10 




-17 


-23 




3. Liking of Histor>' 






19 


12 i 

4 




■ 








4. Liking of Science 








25 ' 

■ t 




-16 


-12 




-09 


5. Liking of Mathematics 








1 
J 


-10 




-10 






6. Difficulty of EiJ^Iish 








« 


J J- -I J 


24 


18 


13 


20 : 


7. Difficulty of Geography 














27 


34 




8. Difficulty of History 
















15 




9. Difficulty of Science 


















17 I 


10. Difficulty of Mathematics 





















*A correlation of .09 is required for statistical significance at p'<.OS; 
.12 for significance at p <.01. Only statistically significant correla- 
tions are reported in this table. Decimals have been omitted in the 
body of the table for ease of reading. 



BelatioKships of Age^ Verbal Ability 
and Attitudes to Aohieverr-p^nt 

' Table 9 gives correlations of age, sex, verbal ability and atti- 
tude scores with tests and ratings of student achievement in the areas of 
Reading, Writing, Listening, Speaking and Verbal Creativity.^ Only 
statistically significant correlations have been reported. The reader 
should note that, because of the design of the study and characteristics 
of the tests used, the correlations in various areas are based on differ- 
ent numbers of students enrolled in different clusters of grades, In all 
cases, hbwever, the number of cases is qjiite large (240 to 582) and the 
samples of students reasonably comparable. 

Most noticeabl^i^' these findings are the substantial relation- 
ships between verbal abrf^ty and achievement, especially in the areas of 
silent reading, listening and writing.^ This suggests that success on 
these achievement tests depends fairly substantially on verbal ability 
or 'thinking skills*- as well as upon more mechanical skills and rote 
knowledge of the conventions of English communication. 



"More detailed descriptions of these relationships are fqund in the series 
of papers addressed to each of the main areas of the Intermediate program 
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It IS also noteworthy that, aiong the attitude scales, those 
measuring Enjoyment of Reading, Usefulness of Graninar and Application of 
English Skills show the most substantial relationships to the various 
achievement measures. Although the correlations are small or modest in 
size, they do indicate that a minor but significant part (5-15%) of- the 
variation in student achievement is associated with attitudinal factors. 
This merely confirms the educational rule of^umb that students tend to 
learn best w;Jiat they want to learn, enjoy or teel is important to them. 

SUMMARY 

This p^er, largely through a series of tables and figures, has 
sujiunarized students' respqnses to measures of their ^ attitudes toward 
various facets of the Intermediate English program ancf compared them ^with 
the responses of similar students tested in a prior study (May, 1973]. 

Sex differences and grade .trends were described, correlations 
among the various attitude measures presented, and students' rating of 
liking of, and difficulty with, English and four other academic subjects 
compared and contrasted. 

A brief analysis of a hypothesized interaction of teacher-sex and 
student-sex' on attitudes was presented along with adetailed table giving 
correlations among sex, age, verbal ability and attitude measures with , 
tests of student achie\^ement in major areas of the program. 

In general, the findings of this study confirm those of the earlier 
one with the same consistent sex differences and grade trends very much in 
evidence. The various attitude measures show significant but modest rela- 
tionships to measures ot achievement. Verbal ability appears to play an 
especially important role in student achievement in, the areas of read^-ng, 
listening and writing. 
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APPENDIX A 



SCALES USED BY STUDENTS TO RATE THEIR LIKING FOR, AND DIFFICULTY WITH, FIVE 

DIFFERENT ACADEMIC SUBJECTS. 



V-VMl 



SCHOOL; 



GRADE: 



LIKING AND DIFFICULIy OF SUBJECTS 

Instvuations to the Student 

Listed below are ten short statements. Beside each one i s a scale which you can 
use to show the degree to which you either agree or disagree with the statement. . 

Read each statement and then put, a circle around the word or words which best 
tell how strongly you agree or disagree with that statement. Do all ten statements the 
same way. 

When you have finished rating all ten statements, turn ovet^he page and read the 
list of school subjects printed there. - ^ n 

Draw a line through any sub^^^?^s. you are not_ taking this year. 



disagree 



disagree 



disagree 



disagree 



strongly 
disagree 



strongly ^ 
I like Science agree agree undecided 

strong;iy 

Math is difficult 'foT me agree agree undecided 

strongly • 

Geography is difficult for me. agree agree . .undecided disagree disagree 

• . strongly . _ 

I like History agree agree undecided disagree di^*fgT^ 

strongly 

Science is difficult for me..' .. agree agree undecided" 

Strongly 

I like. English agree agree undecided 

•» 

strongly 

1 \ ike Geography : agree agree undecided 

Er|c Z/.i 



strongly 
disagree 



strongly 



strongly 



strongly 
disagree 



strongly 
di sagree 



strongly 
disagree disagree 
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Appendix A - Continued, 



English is difficult for me. 



strongly 
agree 



agree undecided disagree 



strongly 
di sagree 



I like Math. 



strongly ' ^ strongly 

agree agree undecided disagree. disagree 



History is difficult for me. 



strongly ' ' ' strongly 

ajgree agree undecided disagree disagree 



4 



Listed below are five subjects that you may be talcing this year. 

If there are any subjects on this list that you are n£t taking this school 
year, put a line through their names* 

^ Science 
History 

Geography «^ , 

Engljish 

Mataematids 



ERLC 
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Visits were made to two -elementary "feeder" schools and one secon- 
dary sch'ool'in four areas of the city. Some classroom visits were made, 
' ■ .-. A ^ ^ — 1 — t+mes when 



but generally it was more satisfactory to^talk to. teachers at ^e 
they could be .firee from their classroom duties. • 



In any attempt to find a common pattern of development in the ' 
English prograjT,, it is essential to recognize that environmental factors 
in temis of socio-ecpnomic levels as well as parents', teachers' and 
students' expectations will provide a wide range of offerings and ot 
perfomran^ within 'one school system. 

From AiscuSsions with approximately forty-six efeTltentary school 
teachers and pfincipals and twenty-two secondary school -personnel , it ^is 
possible to isolate several recurring comments which inbi£ate,a commonality 
. of students' strengths as well as weaknesses in respotts^e to the existing ^ 
[,anguage Ajfts.jirogramJ . " ^ V 

It' is interesting to note that few of the people interviewed comi^ 
7 plained that they were unable to reach their stated goals in student 
achievement becaus?" m«teri als or equipment were not available. Nor was 
there evidence of faiilt-finding in relation to the teaching thft studerjts 
had received at an earlier grade Ipvel. Indeed, most teachers interviewed 
indicated that- they ^ere prepared to take students "Where. they are" and \ 
provide a program consistent wi'th their needs. • ■. 

Several respondents who work with students whose .aptitudes and 
' interests mark them as nonracademic were Convinced that the substance of 
the program v4s of less importance than the social values to *be gained ^ 
frcim exposure to it. One strong point was made that while lip-service 
miglit be paid to the basic importance of a vigorous Language Arts program, 
•the incursion of electives, oral French, physical education, shops and 
home economics, guidance, and mi^ic - ail valid in their own right - -had 
. so diluted the t ime .^^vai lab le in' the el-ementary school for English that a 
full, meaningful prSgrain was impossible to achieve. 

*~ -.In addition to" the previous observation, it is self-evident that 

while in the secondary school courses in English are taught Almost exclu- 
sively persons who have considerable background - including specializa- 
tion - in theVuhiect, there- ^e . man^ elementary t9achers involved in the 
Language Arts program whose aBidemic interests and qualifications are m 



subject areas other than English. Such an observation does not^all into 
question the ability of these teachers to provide instruction in. Language 
Artsi but it does indicate that there will, be a wide variety in the content 
*of the programs ^d the enthusiasm and singleness of purpose with which 
they will be presented. 

i 

^ On the other hand there is a vafuable advantage for th^ teacher 
withWfore program who can integrate the aspects of a' Language Arts pro- 
gram into more than one subject area. The l^eadership that the teacher 
cafi give in oral wor^L, in reading related to subjects other than literature, 
to'organiiatioTi skills, and to proficiency in not^-makipg, helps -to enlarge 
the students*, ability to apply tlife skills pf English to other areas of the 
curriculum. ' ^ 

If curriculum direction at the Ministp' level moves toward the 
establishment of core sub-jects in the Intenn^'ate Division, an<J if the 
Language Arts form a part of that core, some of the concerns over dimin- 
ished time for English and the apparent absence of sufficient emphasis on 
skills development may be overcome. " " ^ . 

The following .comments by teachers are arranged at pre^sent grade , 
levels so that examination of specific needs may be easier. 



GRADE 7 



^tren^ths lioted t> Zeaahevs 



generally good capability in oral work .but encouragement to develop 
sei1r*^e^ilfidence is needed. 

Good resporis e lo 5 '^ c Tassroom drama" approach were it is possible. ^ 
Some evidence of enjoyment in reading. ^ ^ 

Abler students show the beginning of an ability to see boyond 
literal meanings in literature. * " 

Will* still make an emotional response to poetry especially. . ^ - 



¥^'eaknesse3 Ho ted 

V 



- Deficient in vocabulary skills; paucity of vocabulary; lack of 
^precision in us age ^, 

- Written\ork IS inferior in quality to of al response . 

- Research activities, become copying exercises with little attempt 
to apply research information to the project. 

- Oral reading is gejierally poor. . . 

- Considerable motivation for writing must be supplied-r ^ ; 

- Failure to recognize .the pattern of sejitence development.^ 

- Lack of concern for organization; spelling, penjnanship. 




GRADE 8 

~ Strengths N^ted- * . ^ 

- Some maturity is developing in listening and speaking skills. 

- StudentsVill be specific in answers once a pattern is developed. 

- Participate well in discussions. 

' Show, some enjoyment in reading; fairly clo^e to theit ^grade 
' ' level in measured skills of reading. ■ 

- Evincing some imaginative and creative ability ^n writtea work 
(baUnced by the comment on weakness in vocabulary', sentence 
construction). 

l^eaknesses IJoted 

w - Written work is imaginative but sentence structure and usage 

are weak , 
' - Vocabulary skills are weak. 

- Onen unwilling to revise .th^ir writing; beginning to develop 
resistance to written work. i 

- Prone to make sweeping generalizations in both oral and written \ - 
% communication. 

- Evidence of some reluctance to share their response, especially 
an emotional ojie, with their peers. 

- Show resistance to and dislike for material from the basal reader. • 

Gomment varies on students' response to the tBeaching of grammar at 
Grade' 8 level/ Some teachers feel there is a strong need to develop a , 
grammar response; others sense that their students are highly resistant 
to. formal grammar and while they admit the students* lack of knowledge of ^ 
structural forms and of terminology, they feel that to present these in a 
didactic way frustrates the s'tudents as well as the teacher. 

When teachers are presented with the idea that it is possible to 
teach the necessary grammar in a fofn that relates it directly to conven- 
tional patterns of standard English in bSj^ speech and writing, that is, 
in a functional way, they feel reassurec^ The main concerns appear to be 
those of terminology and' detailed analysis. If a structural or pattern 
approach can be followed in grades 7 andS, it seems possible that there 
can be more likelihood of re^sponse to t^inology in- grade 9 and 10. 
Recent research from Britain indicate^ that students do not comprehend the 
more formal approach to grammar until the age of 14 or later. ^ " . 

Perhaps teachers at the Secon^^r^Ljfevel will have to accept a min^ 
I'mal amount of knowledge of grammar in their grade 9 students and* devise 
a progr'am related to the students* needs and ability to respond rather » 
than merely dismissing incoming students as incompetent in their knowledge 
of both termicnology and function. , - 



ERIC ^/.^ \^ 



GRADE 9 



Strengths Hotei^ 



- Generally articulate, adequate vocabulary. 

- Fairly good in creative writing. • 

- Respond well to adequate motivation. 

- Most can keep pace in reading assignments. 

- Willing to engage in discussion. . ' n 

- Transfer discussions in literature ta life situations iwel 1 . 

- Express opinions fre.ely and openly. ' 

- Participate cooperatively in dramatization. 

- Enjoy project work. 

- Have adequate reading abilities (with some exceptions). 
-Respond well to literature which helps develop attitudes; 



- Writing ability does not match oral competence. 

- Paucity of vocabular>' results in lack of precision, finesse. 

- Do not carry instruction in grammar, spelling, usage or 
structure into their written work. 

- Lack note-taking and organization skills. , , - , 
^ Prone to generalizations and emotional rather than logical 

response. . ^ . ^ ~, . 

- Resistant to constructive criticism of their oral or written 

expression . 

- Do not appear to have a respect for language.- 

- Unable to recognize errors in their own work. 



GRADE 10 



Most of the comments concerning grade 9 were repeated. In addition 

- Some improvement in supplying evidence. 

- .^swers in written form are expanded over previous level. 

- Greater willingness to keep discussion on topic. 

- Improvement' in reasoning power, n>aking inferences, drawing 

conclusions . * 

- More controlled approach to story writing. f 

- Respond to a ''game^' approach to listening skills. 

; 



Miss details in oral instructions. \ ' ^ 

Need specific outlines of metheds of answering in wntt^ 

assignments. 

Reluctant to supply adequate information in written answers, 
Still reveal difficulties ipor^ani^ing sentence patterns. 
Need further emphasis on mechanics, usage, patterns. 



ieachers' answers to a question about students' attitudes to 
Inglish varied. . Some felt their classes responded uell and sbbved en'joy- 
ment where reading, discussion, dramatization, projects and other involve- 
:nent were the topics. Khen the application tcj writing was required, 
students were reluctant to respond until a high degree of motivation was 
provided. RcMsing written exercises, word study and spelling, granroar, 
precise response and supplying supporting evidence appeared to be unpop- 
ular and poorly executed. 



: CONSENSUS I.S TEACHERS' GENERAL REMARKS 

It was evident that many teachers felt the pressure of having too 
r.any tilings that needed to be done in the area of improving coranuni cAt ions 
sV 1 lis . • 

ihe general iinproveraent ir. students' oral work is not reflected m 
their writing, -one lac^ of assurance was eMdent about ways m which writ- 
ing night be impro\ed. In grades 9 and 10 the strip timetable and the in- 
crease in the nur.ber of classes assigned to the teacher of English have 
contributed to an emphasis On. the teaching of more literature and generally 
lcs<; compo-itior. as one method of reducing the marking load. 'Jet most 
te^c.'iers admitted that they felt they would like to be able to spend more 
tire develop-mg writing proficiency in ^their students. 

' "Language •exDerience"-program.s in students' backgrounds do not 
^c-- to have ger.erat'ed ir^)rovem.ent in vocabulary skills. General comm.ent 
ipJic^ttd paucitv of -.oca'bulary resource in the students in the Intermediate 
grades. Whether' a return to more foraal methods of word study is a solution 
to this lack of vocabulary is difficutt to. say, but many teachers are giving 
thought to emphaii:ing vocabulary skill throughout their programs. 

Inability to organize response in both written and oral forr. would 
indicate that within the "-10 grade span either students have difficulties 
in this phase of the work unfdreseen by teachers or that insufficient follow 
up to .student a'i's igptnents is arranged. 

Ihe frequent. reference to lack of listening skills is indicative 
of a need for more than Passing acknowledgement that listening as a skill 
needs, to ;oc included as a valid part of 'the overall communications program. 

- heading proficiency was frequently mentioned' at the grade "-8 level 
as i'fing a r.a>or concern-, 'in 9-10 teachers feel that many students are 
jeading- at or' near the grade level. Perhaps the figures on watching tele- 
Msion tire <uppJrtive of, the belief that -as the student begins to disoriifl- • 
mate with growing maturity about what' he watches, his reading in;ter§sts 
develop. \ccordiTig to l.ducation .Service Bulletin Vol. 1. So. 9 (1971) 
M)-'. Degrade six pupil? watch at least 20 hours per week of television; 



by grade thirteen, only spend that amount of time. 'Less than 4 hours 
per week of television viewing was reported by 32% of grade thirteen 
students, ' / 

To look at the -weaknesses only in students as reported by teacher- 
respondents is to give an unrealistic picture of student abilities in 
English. Certainly there are indications from most of those interviewed 
that students can and do re^spond in language applications to oral and 
written assignments, to reading, and to listening aijd response skills. 

'•4 

It IS necessar>s it seems to me, in view of the mainly heterogen- 
eous groupings in most English classes to recognize the wide differences 
in students' ir.otivatiort^, background, expectat^'ons and capabilities and 
to realize that it will \)e impossible for all students to reach the same 
standards of achievemelfr^t either t^ie grade or age level. 



CONCLUSIONS 

K'hat develops clearjy from myvVisits to classrooms and my discussions 
with teachers is first, that njore enphasis is necessary -on some fundamental 
skills. This can be achieved through the different methods of newer p'resen- 
tatioi; which have evolved. Second that if de^lopfflfent of competence in 
'writing IS a valid expectation, then obvioysly more time will havej^to be 
provided for students to engage m, writing. Third, that while physical and 
er.otional development of many chi Idren ^in ,the Intermediate Division may 
appear T::atiire, their experience in responding to the forms and conventions 
of language use is not. 

^ WTien the mforriation of this report and the results of the question- 
naire, subnitted to a group of teachers in the London schools are compared, 
I would assure that some common pattern of response ta recognized weaknesses, 
strengths and needs v^puld emerge. 

Should .the English Committee decide to prepare* a Guideline; in 
English for the Intermediate grades in London schools, it can incorporate 
those Items that appear to need reinforcement at specific grade levels. 
It should be clear, however, that the factors of environment, motivation 
and capability will nake it difficult for all students to absorb or respond 
equally to the material presented at a particular level sp that continuing 
reinforcement of basic skills performance will need to take place. 
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